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The  objective  of  this  thesis  was  to  determine  whether  or  not,  and  by  how  much, 
three-dimensional  graphs  are  more  accurate  and  efficient  than  two-dimensional  graphs  and 
tables  when  p'esenting  alternatives  to  decision  makers. 

A  graphical  experiment  was  designed  using  a  microcomputer.  This  experiment 
presented  a  business  scenario  to  test  Air  Force  Institute  of  Technology  (AFIT) 
Professional  Continuing  Education  (PCE)  students.  The  experiment  attempted  to 
determine  how  well  DoD  decision  makers  accurately  and  efficiently  performed  elementary 
data  collection  tasks  using  various  graphs  or  tables. 

The  experiment  used  a  randomized  order  within-subject  factorial  design  with  repeated 
measures.  The  factorial  experiment  was  designed  to  analyze  the  manipulation  of  three 
factors  or  independent  variables,  anchoring,  mode  of  presentation,  and  data-set,  to 
determine  their  effects  on  the  response  variables  of  degree  of  accuracy,  and  response  time 
(efficiency). 

The  results  of  the  accuracy  analysis  showed  that  in  general,  accuracy  performance 
was  high  for  most  subjects  regardless  of  the  mode  of  presentation  or  the  task  anchoring. 
The  timed  response  analysis  showed  that  it  took  subjects  longer  to  interpret  three- 
dimensional  line  graphs  and  three-dimensional  bar  charts  for  two  of  the  elementary  data 
collection  tasks. 
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Abstract 

A  randomized  order  within-subject  factorial  design  with  repeated  measures 
experiment  was  conducted  to  assess  how  well  DoD  decision  makers  accurately  and 
efficiently  performed  elementary  data  collection  tasks  using  various  gr^hs  or  tables. 

The  factorial  experiment  was  designed  to  analyze  the  manipulation  of  three  factors  or 
independent  variables,  anchoring,  mode  of  presentation,  and  data-set  to  determine  their 
effects  on  the  response  variables  of  degree  of  accuracy,  and  response  time  (efficiency).  In 
this  experiment  five  treatment  levels  were  selected  for  mode  of  presentation:  table,  two- 
dimensional  bar,  two-dimensional  line,  three-dimensional  bar,  and  three-dimensional  line. 
Four  treatment  levels  were  selected  for  task  anchoring:  high  x,  high  y;  high  x,  low  y;  low 
X,  high  y;  and  low  x,  low  y  value  anchoring.  The  third  factor,  data-set  combination,  used 
two  unique  dats-set  treatment  levels. 

Data  extraction  accuracy  was  not  significantly  affected  by  presentation  format.  The 
timed  response  analysis  showed  that  for  the  high-high  anchoring  questions  three- 
dimensional  line  graphs  took  the  longest  to  interpret.  There  were  mixed  results  for  the 
high-low  anchoring  questions.  The  bar  charts  were  expected  to  be  interpreted  faster; 
however,  the  three-dimensional  bar  chart  took  the  longest  to  interpret.  All  of  the  modes 
of  presentations  were  interpreted  relatively  the  same  for  the  low-high  anchoring  questions. 
The  line  graphs  were  expected  to  be  the  fastest;  however,  the  results  of  this  study  showed 
no  difference.  Subjects  interpreting  the  line  graphs  spent  less  time  performing  low-low 
anchoring  questions,  than  they  did  interpreting  the  other  modes  of  presentation.  Overall, 
the  analysis  could  not  detetermine  that  there  were  any  elementary  data  collection  tasks  in 
which  three-dimensional  graphs  facilitated  more  accurate  and  efficient  solutions  than  two- 
dimensional  graphs  and  tables. 
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THE  EFFECT  OF  THREE-DIMENSIONAL  GRAPHS  ON  DECISION-MAKING 
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I.  Introduction 


General  Issue 

The  underlying  purpose  of  using  graphics  can  be  found  in  the  old  adage,  "A  picture  is 
wcnrth  a  thousand  words."  A  graphical  image  has  the  ability  to  summarize  complex 
relationships  among  large  quantities  of  data  into  an  easily  understood  trend.  This  makes  a 
graph  an  effective  tool  for  influencing  our  perception  of  the  relationships  that  exist  in  the 
data  being  portrayed.  It  also  makes  a  graph  extremely  useful  in  the  decision-making 
process.  Advanced  computer  graphics  packages  have  become  powerful  and  essential 
tools  in  communicating  information  to  decision  makers.  Computer  gr^hics,  especially  in 
business,  have  become  an  important  element  in  the  presentation  of  information  either 
internally  or  to  the  public. 

How  a  person  presents  his  or  her  ideas  is  critical  in  the  decision  -making  process. 
According  to  Needleman,  "Regardless  of  whom  you  are  making  a  presentation  to,  the 
purpose  of  a  presentation  isn't  to  make  your  point,  but  to  sell  an  audience  on  your  point  of 
view!"  (15: 15).  Using  graphics  is  an  effective  method  to  communicate  those  ideas,  and  it 
enhances  the  chance  of  success.  The  success  or  failure  of  an  individual's  presentation 
hinges  on  two  factors:  how  convincing  the  presentation  is,  and  how  accurately  decision 
makers  interpret  the  graph.  "You  not  only  have  to  understand  what  information  you  need 
to  present,  but  also  the  best  way  to  present  it  so  that  it  reinforces  your  final  goal,  not 
♦  obscures  it"  (15:15).  The  presenter  must  select  an  appropriate  graphical  format  that  will 

capture  the  audience's  attention  and  enable  the  audience  to  make  an  accurate  decision. 


1 


Specific  Problem 


Statements  such  as  graphics  lead  to  more  effective  analysis  and  decision  making; 
graphics  help  users  to  find  problems;  graphs  make  tasks  less  difficult;  and  graphics  make 
presentations  more  convincing,  are  typical  claims  graphics  vendors  make  to  sell  their 
products.  Some  researchers  claim  these  statements  are  myths,  and  other  researchers 
acknowledge  they  just  do  not  know  (12:1).  During  a  two-year  study,  a  University  of 
Miruiesota  research  team  investigated  the  effectiveness  of  using  business  gr^hics  (12:1). 
The  team  presented  five  key  findings  in  the  study:  graphic  use  will  increase  in  the  future, 
graphics  will  find  their  greatest  use  in  decision  support  and  communication,  there  is  a 
learning  effect  with  graphs,  the  superiority  of  graphs  over  tables  is  not  supported,  and 
there  is  a  great  opportunity  for  misuse  of  graphics  (12:4). 

Although  the  Department  of  Defense  (DoD)  is  a  non-profit  organization  and  is  not 
considered  a  corporation  or  business,  it  is  an  organization  where  essential  decisions  must 
be  made  by  managers  at  all  levels  of  government  Communication  and  the  transfer  of 
necessary  infOTmation  is  critical  to  our  national  defense.  The  data  presented  to  managers 
is  often  in  the  form  of  graphics  to  help  facilitate  decision  making  and  consolidate 
enormous  quantities  of  data.  Since  DoD  has  a  centralized  decision  making  style,  and  the 
decisions  made  by  lower  level  managers  impact  higher  level  managers  decisions,  it  is 
absolutely  essential  information  is  portrayed  accurately.  The  results  attained  from 
graphics  research  will  legitimately  aid  decision  makers  in  understanding  data  formulation. 
The  research  will  help  managers  understand  issues  such  as  graph  characteristics,  which 
modes  of  presentation  are  most  suitable  for  a  given  task  question,  which  modes  of 
presentation  have  the  lowest  comprehension,  and  which  modes  of  presentation  are  the 
most  time  consuming.  If  DoD  managers  are  educated  on  the  effect  of  ill-prepared 
graphics,  and  how  these  graphs  can  misrepresent  data,  they  will  be  given  the  tools  to 
become  even  better  decision  makers. 
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In  the  past,  researchers  have  focused  a  significant  amount  of  attention  on  the  effects 
of  graphical  format  on  decision  making.  However,  researchers  have  neglected  to  examine 
the  effects  of  three-dimensional  graphs  on  decision  making  accuracy  as  well  as  the 
efficiency  of  three-dimensional  graphs.  Accuracy  is  defined  as  the  correct  response  given 
to  a  particular  scenario  or  task,  and  efficiency  is  described  as  the  timeliness  of  making  this 
decision  associated  with  the  given  mode  of  presentation.  Thus,  the  objective  of  this  thesis 
is  to  determine  whether  or  not,  and  by  how  much,  three-dimensional  graphs  are  more 
accurate  and  efficient  than  two-dimensional  graphs  and  tables  when  presenting  alternatives 
to  decision  makers.  For  the  purpose  of  this  study,  the  two-dimensional  graphs  (Figure  1) 
display  data  plotted  using  only  a  horizontal  and  vertical  scale  (x-axis,  y-axis).  Three- 
dimensional  graphs  (Figure  2)  also  display  data  plotted  using  a  horizontal  and  vertical 
scale;  however,  these  graphs  add  only  an  aesthetic  third  dimension  that  provides  a  depth 
perception  (i.e.  no  values  are  plotted  using  the  z-axis). 


Figure  1.  Two-Dimensional  Graph  Example. 
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Figure  2.  Three-Dimensional  Graph  Example. 
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Investigative  Questions 

The  following  investigative  questions  need  to  be  addressed  to  achieve  the  objective  of 
this  thesis: 

1 .  How  extensively  are  computer  generated  graphics  used  in  business  today? 

2.  What  are  the  standard  criteria  used  when  formatting  graphics  to  avoid  misleading 
graphics? 

3.  Do  various  modes  of  graphical  presentation  affect  the  accuracy  associated  with  given 
elementary  data  extraction  tasks? 

4.  How  efficient  are  the  various  modes  of  graphical  presentation  associated  with  given 
elementary  data  extraction  tasks? 

5.  Are  there  any  demographic  characteristics  of  the  participants  which  affect  their  ability 
to  efficiently  perform  elementary  data  collection  tasks? 

6.  Are  there  any  elementary  data  collection  tasks  in  which  three-dimensional  graphs  » 

facilitate  more  accurate  solutions  than  two-dimensional  graphs  and  tables? 
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7.  Aie  there  any  elementary  data  collection  tasks  in  which  three-dimensional  graphs 
facilitate  more  efficient  responses  than  two-dimensional  graphs  and  tables? 


8.  Which  graphical  format  is  appropriate  for  a  given  task? 

^  The  first  two  investigative  questions  will  be  addressed  in  the  literature  review. 

Investigative  questions  three  through  eight  will  be  answered  through  an  experiment 

Scope/  Limitations  of  the  Research 

Researchers  have  studied  a  variety  of  topics  related  to  graphical  presentation.  Many 
of  the  experimental  results  from  research  studies  performed  to  determine  the  effectiveness 
of  graphics  have  been  contradictory  (9:464).  The  contradictory  results  are  due  to  the  vast 
assortment  of  dependent  variables  used  in  graphics  research.  The  following  are  the  major 
dependent  variables  used  in  graphics  research:  (1)  interpretation  accuracy,  (2)  problem 
comprehension,  (3)  task  performance,  (4)  decision  quality,  (5)  speed  of  comprehension, 

(6)  decision  speed,  (7)  memory  -  recognition  and  recall,  and  (8)  viewer  preference 
(9:468).  This  thesis  will  focus  on  three  of  these  dependent  variables:  interpretation 
accuracy,  task  performance  and  decision  speed.  There  will  be  three  independent  variables 
considered  in  the  study:  task  anchoring  (question  type),  mode  of  presentation,  and  data¬ 
set  combination. 

The  presenter  has  a  multitude  of  graphical  methods  available  to  consider  when 
preparing  information  for  presentation.  The  following  are  some  examples  of  graphical 
methods:  line  charts,  bar  charts,  pie  charts,  dot  charts,  Tukey  box  plots,  and  symbol 
charts.  The  various  graphs  can  be  displayed  either  two-dimensionally  or  three- 
*  dimensionally.  However,  this  study  will  only  compare  and  contrast  tables,  two- 

dimensional  line  and  bar  charts,  and  three-dimensional  line  and  bar  charts.  Chapter  HI, 

<  Methodology,  describes  the  use  of  these  graphical  methods  in  the  construction  and  design 

of  the  experiment  to  determine  if  and  how  three-dimensional  graphs  are  more  accurate  and 
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efficient  than  two-dimensional  graphs  and  tables  when  presenting  alternatives  to  decision 
makers. 

4 

Conclusion 

The  literature  Review,  Chapter  H,  discusses  the  use  of  business  graphics  in  business,  * 

and  explains  why  graphics  have  become  such  an  important  element  in  the  presentation  of 
information  either  to  internally  or  to  the  public  (first  and  second  investigative  questions). 

The  Methodology,  Chapter  HI,  explains  and  justifies  the  experimental  design,  pertinent 
concepts,  construction  of  the  experimental  item,  and  the  procedures  used  for  administering 
the  experiment.  Chapter  HI  also  provides  a  brief  discussion  of  the  statistical  analysis  to  be 
used  on  the  experimental  results.  The  Data  Description  and  Analysis,  Chapter  FV, 
discusses  the  data  retrieval  processes,  and  the  statistical  analysis  techniques  used  to  justify 
the  significant  differences  in  the  data.  Finally,  Chapter  V,  Findings  and  Conclusions, 
discusses  the  conclusions  of  the  tested  hypotheses  and  provides  recommendations  for 
future  research. 
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n.  Literature  Review 


Introduction 

Advanced  computer  graphics  packages  have  become  powerful  and  essential  tools  in 
communicating  information  to  decision-makers.  Whether  an  individual’s  presentation  is  a 
success  (selling  the  audience  on  a  point  of  view)  or  failure  hinges  on  three  factors:  how 
convincing  the  presentation  is,  how  efficient  graph  interpretation  is,  and  how  accurately 
decision  makers  can  interpret  the  graphs.  Thus,  the  presenter  is  faced  with  an  unenviable 
task.  The  presenter  must  choose  a  graphical  format  that  will  capture  the  audience's 
attention  and  enable  them  to  make  an  accurate  decision  in  a  limited  time  frame.  Before 
presenters  can  make  these  kinds  of  decisions,  the  effect  of  each  graphical  format  on  an 
individual's  decision  should  be  considered.  The  objective  of  this  thesis  is  to  determine 
whether  or  not  three-dimensional  graphs  are  more  accurate  and  efficient  than  two- 
dimensional  graphs  and  tables  when  presenting  alternate  choices  to  decision  makers.  This 
literature  review  will  focus  on  the  background  of  graphical  research  and  the  major 
findings. 

This  chapter  is  divided  into  four  separate  sections.  The  first  section,  use  of  graphics, 
discusses  how  computer  graphics,  especially  in  business,  have  become  an  important 
element  in  the  presentation  of  information  either  internally  or  to  the  public.  The  second 
section  addresses  the  criteria  for  high  integrity  graphics  and  the  human  perceptual  and 
memory  mechanism  limitations.  The  third  section  is  a  comprehensive  review  of  past 
research  on  graphical  topics,  and  the  fourth  section  is  a  conclusion  which  addresses  how 
the  review  relates  to  our  thesis  objective. 

Use  of  Graphics 

In  1984,  marketing  specialists  estimated  the  computer  graphics  industry  was  growing 
at  an  annual  rate  of  approximately  60  to  70  percent  (9:463).  Now,  in  1994,  because  of 
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computer  hardware  and  software  technology  advances,  businesses  have  capabilities  they 

have  never  had  before.  Government,  coiporations,  and  even  small  businesses  use  ^ 

advanced  computer  graphics  packages  to  generate  presentations  to  communicate 

information.  Often,  presenters  display  cost  data  in  graphical  form  to  concisely  present 

information  to  executives.  The  DoD  uses  these  graphics  packages  to  perform  risk,  cost, 

and  failure  analysis  as  well  as  to  portray  large  quantities  of  information  necessary  to  both 

operational  and  acquisition  decision  makers. 

Accountants  as  well  as  cost  analysts  are  extremely  concerned  with  presenting  data 
with  accuracy  and  clarity  to  increase  the  executive's  ability  to  make  a  decision.  Graphics 
are  typically  used  to  make  a  point,  illustrate  a  trend,  or  make  comparisons  so  the  data  are 
more  easily  understood.  Accountants  often  have  to  persuade  an  executive  to  allocate 
funds,  and  graphics  are  the  most  effective  tool.  A  senior  accounting  manager  of  a  major 
oil  firm  stated  that  an  accountant  not  only  has  to  be  good  at  his  or  her  job,  but  he  or  she 
must  be  a  good  salesperson  to  succeed  (20:18).  How  a  person  presents  ideas  is  critical  in 
the  decision  making  process,  and  using  graphics  to  communicate  those  ideas  is  a  method 
for  success  (20: 18).  Accountants  use  graphics  for  the  following  reasons:  problem 
comprehension  (graphs  have  dimensionality),  task  performance  and  decision  quality 
(improvement  in  comprehension  of  data),  speed  of  comprehension,  decision  speed, 
memory  of  information,  and  viewer  preference  (14:19-20). 

Newspapers  are  also  interested  in  graphics  capabilities.  Newspapers  now  realize  that 
to  lure  readers,  graphics  are  required  to  attract  their  attention.  According  to  Roger  Fidler, 
Knight-Riddler's  director  of  graphics  and  newsroom  technology,  "the  great  demand  for 

* 

informational  graphics  has  come  largely  from  a  recognition  that  newspaper's  readership  is 
declining  and  that  newspapers  must  become  more  effective  at  visual  communications" 

(26:3 18).  "The  American  Society  of  Newspaper  Editors  found  that  92%  of  newspapers 
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planned  to  use  more  informational  graphics  in  the  next  five  years,  and  90%  of  newspapers 
said  graphics  would  play  an  even  bigger  role  by  the  year  2000"  (26:318). 


Graphics  Criteria  and  Perceptual  Linaitations 

Graphical  research  started  in  the  early  part  of  this  century.  In  1915,  a  group  of 
statisticians  formed  the  Joint  Committee  on  Standards  for  Graphic  Presentations.  The 
objective  of  this  committee  was  to  establish  “convenient  standards”  for  presenting 
statistical  data  in  graphical  form  (2:791).  The  committee  hypothesized  that  these 
standards  would  make  graphs  more  widely  used,  “with  a  consequent  gain  to  mankind 
because  of  the  greater  speed  and  accuracy  with  which  complex  information  may  be 
imparted  and  interpreted”  (2:791).  The  standards  they  developed  focused  on  the  format 
of  line  graphs.  Since  this  original  study,  many  researchers  and  organizations  have  focused 
their  effons  toward  the  development  of  graphical  standards.  While  some  of  the 
documented  standards  focused  on  improving  the  presentation  or  professional  appearance 
of  graphs  (1, 16, 17),  others  focused  more  imponantly  on  enhancing  the  analytical 
usefulness  of  the  graphs  (3, 13, 20, 22).  In  the  article  "Criteria  for  High  Integrity 
Graphics,"  Christensen  and  Larkin  identified  nine  “criteria  for  high  integrity  graphics,”  and 
reponed  that  “graphs  which  violate  the  criteria  can  mislead  decision  makers”  (5:130).  The 
following  are  the  nine  criteria  that  when  violated  may  mislead  a  decision  maker  (5:131- 
145): 

(1)  The  graph  should  agree  with  the  data  -  Tufte's  "lie  factor" 
defined  as  the  "size  of  the  effect  shown  in  the  graph  divided  by 
size  of  the  effect  in  the  data"  (25:57). 

(2)  Follow  normal  temporal  sign  conventions. 

(3)  The  stratum  with  the  least  variability  should  be  on  the  bottom 
in  strata  (area)  chart. 

(4)  Labels  should  be  correct. 
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(5)  The  number  of  dimensions  in  the  graph  should  not  exceed  the 
number  of  dimensions  in  the  data. 

♦ 

(6)  Avoid  unusual  scaling. 

(7)  The  scale  range  should  be  close  to  the  data  range.  ^ 

(8)  Avoid  arbitrary  changes  to  grid  proportions. 

(9)  Beware  of  omitted  data. 

The  implication  of  Christensen  and  Larkin’s  study  is  simple:  if  the  criteria  are  not 
followed,  the  graphs  will  be  misperceived  and  inappropriate  decisions  will  be  made.  The 
criteria  identified  by  Christensen  and  Larkin  will  be  followed  in  this  experiment,  except  the 
fifth  criteria,  to  control  any  confounding  effect  that  graphical  formatting  has  on  accuracy 
and  efficiency.  In  this  experiment,  three-diriffinsional  graphs  will  be  compared  to  tables 
and  two-dimensional  graphs.  The  data  portrayed  in  this  experiment  is  two-dimensional; 
however,  three-dimensional  graphs  will  be  studied  using  this  two-dimensional  data. 

Although  three-dimensional  graphs  will  be  compared,  the  third  dimension  is  for  aesthetic 
purposes  only,  and  has  no  value  associated  with  it. 

Although  complying  to  graphical  standards  is  an  important  aspect  in  aiding  graphical 
perception,  it  is  not  the  only  aspect  we  should  be  concerned  with.  Individuals  who 
prepare  graphics  for  presentation  often  do  not  take  into  consideration  the  human 
perceptual  and  memory  mechanisms  needed  to  retain  and  understand  the  presented  data 
(6:24).  These  graphics  preparers  need  to  understand  how  people  process  data  so  they  can 
prepare  and  structure  effective  reports.  Behavioral  scientists  have  noted  that  the  human 
perceptual  system  is  limited  in  its  ability  to  process  information  (6:27).  People  have  a  f 

finite  capacity  to  process  information  concerning  absolute  judgments.  "A  person's  ability 
to  hold  only  seven  items  in  immediate  memory  for  comparison  purposes  has  been  labeled  * 

span  of  absolute  judgment"  (6:28).  This  small  span  of  absolute  judgment  creates  a  need  to 
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group  data.  Therefore,  it  is  important  that  report  formats  use  groupings  that  assist  the 
f  memory  input  process  and  do  not  overload  the  decision  maker  (6:28).  When  someone 

looks  at  a  graph,  the  information  is  visually  decoded  by  his  or  her  visual  system. 

V  A  graphical  method  is  successful  only  if  the  decoding  is  successful. 

Graphical  perception  is  the  instantaneous  perception  of  the  visual  held 
without  apparent  mental  effort,  but  much  of  the  power  of  graphs,  and  what 
distinguishes  them  from  other  information  tools,  comes  from  the  ability  of 
our  preattentive  visual  system  to  detect  geometric  patterns  and  assess 
magnitudes.  (6:828) 

Theoretical  and  experimental  investigations  of  graphical  perception  identified  ten 
graphical  perception  tasks  used  to  visually  extract  quantitative  information  from  graphs. 
Through  experimental  research,  Cleveland  sequentially  ordered  the  tasks  as  follows  (listed 
from  the  most  accurate  to  the  least  accurate):  position  along  a  common  scale,  position  on 
identical  but  nonaligned  scales,  length,  angle,  slope,  area,  volume,  density,  color  saturation 
and  color  hue.  Cleveland  has  determined  that  the  order  these  tasks  are  selected  will 
increase  the  accuracy  of  a  person's  perceptions  of  important  patterns  in  the  data  (6:830). 

The  implication  of  Cleveland’s  findings  is  significant  because  it  allows  us  to 
determine  which  mode  of  presentation  is  best.  For  example,  graphs  that  show  changes 
along  a  common  scale  such  as  bar  or  line  graphs,  should  be  used  as  often  as  possible 
because  people  can  more  accurately  interpret  them.  On  the  other  hand,  graphs  that  exhibit 
changes  in  area  or  volume  such  as  pie  charts,  are  an  extremely  inferior  tool  for  presenting 
information  because  people  cannot  accurately  interpret  them.  Finally,  his  results  indicate 
that  color  should  not  be  used  to  identify  changes  in  magnitude.  Color  should  only  be  used 
,  to  identify  graphical  elements  or  to  attract  attention.  The  experiment  performed  for  this 

thesis  will  use  only  bar  and  line  graphs  to  minimis  the  possible  confounding  effects  these 
graphical  elements  have  on  accuracy  and  efficiency.  Color  will  be  used  in  the  experiment 
to  only  distinguish  between  the  graphical  elements. 
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Comprehensive  Review  of  Applicable  Research 

Although  the  criteria  for  graphical  excellence  and  the  identification  of  the  elementary 
graphical-perception  tasks  improved  how  accurately  graphs  could  be  interpreted,  the 
question  of  whether  or  not  graphs  were  better  than  tables  for  data  presentation  still 
remains.  Much  of  the  early  research  that  compared  graphs  to  tables  provided  conflicting 
results.  DeSanctis  (9),  Davis  (8),  Tan  and  Benbasat  (22),  and  Jarvenpaa  and  Dickson  (13), 
provide  numerous  examples  of  studies  that  conflict  (please  refer  to  Table  1).  Some  of  the 
studies  indicated  graphs  were  superior,  while  others  indicated  they  were  not  superior. 
There  are  still  other  studies  where  the  findings  are  equivocal. 

Table  1  lists  the  studies  which  pertain  to  either  tables,  bar  or  line  graphs.  These 
studies  were  chosen  because  of  their  relevancy  to  this  study.  The  left  column  in  the  table 
lists  name(s)  of  the  researchers  responsible  for  the  associated  studies.  The  second  and 
third  columns  in  the  table  display  the  associated  independent  and  dependent  variables  for 
each  of  the  studies.  If  there  is  more  than  one  dependent  variable  listed,  then  the  variables 
will  be  numbered.  The  last  column  in  the  table  lists  the  associated  results  of  the  study.  If 
the  results  are  associated  with  a  specific  dependent  variable,  then  the  result  will  display  the 
same  number  as  the  dependent  variable  in  the  previous  column. 


Table  1.  Summary  of  Research  Comparing  Graphs  and  Tables. 


Authors 

Independent 

Variable 

Dependent 

Variable 

Results 

Washbume,  1927  (9) 

Tables  vs.  Bar  graphs 
vs.  Line  graphs 

Comprehension  of: 

1.  Complex  static 
comparisons 

2.  Dynamic 
comparison 

3.  Specific  amts. 

Best  Disolav: 

1.  Bar  graph 

2.  Line  graph 

3.  Table 

Carter,  1947  (9) 

Tables  vs.  Graphs 

Problem  Solvine: 

1.  Speed 

2.  Accuracy 

Best  Display: 

1.  Graphs 

2.  Tables 
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Table  1.  Summary  of  Research  Comparing  Graphs  and  Tables  (continued). 


Authors 

Independent 

Variable 

Dependent 

Variable 

Results 

Carter,  1948  (9) 

Tables  vs.  Graphs; 

Interpretation  speed 

Tables  best  for 

observed  pts  vs. 
interpolation 

and  accuracy 

pt  reading; 
graphs  for 
interpolation 

1  Feliciano  et  al.,  1963 
(9) 

Tables  vs.  Bar  graphs 

Interpretation 

Graphs  are 
better 

Wainer  &  Reiser, 

1976  (9) 

Tables  vs.  Bar  graphs 

Reaction  time 

Bar  charts  are 
better 

Benbasat  & 

Tables  vs.  Graphs 

Performance;  report 

Graphs  are 

Schroeder,  1977  (9) 

preference;  decision 
effectiveness 

better 

Zmud,  1978  (9) 

Tables  vs.  Bar  graphs 

1.  Preference/ 

Best  Disolav: 

vs.  Line  graphs 

perceived  relevance 

2.  Perceived  accuracy 

Line  charts  | 

(best); 
tables;  bar 
charts  (least 
preferred) 

1  Lusk  &  Kersnick, 

Tables  vs.  Graphs 

1.  Performance 

Best  Disolav: 

1979  (9) 

2.  Learning 

Tables  for  both 

1  Lucas  &  Nielson, 

Tables  vs.  Graphs 

1.  Performance 

1.  No  effect 

1980  (9) 

2.  Learning 

2.  No  effect 

Davis,  1981  (9) 

Tables  vs.  Graphs 

1.  Performance 

2.  Confidence 

3.  Decision  Time 

1.  No  effect 

2.  No  effect 

3.  No  effect 

Ghani,  1981  (9) 

Tables  vs.  Graphs 

1.  Performance 

2.  Decision  Time 

3.  User  preference 

Best  Disolav: 

1.  Tables 

2.  Tables 

3.  Feeling  type 
-  graphs; 
thinking  type  - 
tables 

Lucas,  1981  (9) 

Tables  vs.  Graphs 

1.  Problem 
understanding 

2.  Task  enjoyment 

3.  Perceived 
usefulness  of  report 

Best  Disolav: 

1.  Graphs 

2.  Graphs 

3.  Tables 
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Table  1.  Summary  of  Research  Comparing  Graphs  and  Tables  (continued). 


Authors 

Independent 

Variable 

Dependent 

Variable 

Results  1 

I  Powers  etal.,  1982 
(9) 

Tables  vs.  Graphs 

Comprehension  scores 

Tables  are  | 

better 

Watson  &  Driver, 

1983  (9) 

Tables  vs.  3D  graphs 

1.  Immediate  recall 

2.  Delayed  recall 

Best  Displav: 

1.  No  effect 

2.  No  effect 

Zmud,  1983  (9) 

Tables  vs.  Graphs; 

Task  complexity 

Decision  quality 

Graphs  are 
better  for  low 
complexity 
tasks;  tables 
for  high 
complexity 

Blocher  et  al.,  1986 
(8) 

Tables  vs.  Grt^hs; 

Task  complexity 

Decision  quality 

Graphs  are 
better  for  low 
complexity 
tasks;  tables 
for  high 

complexity  | 

Dickson  et  al.,  1986 
(8) 

Tables  vs.  Graphs 

Bar  graphs/  Line 
graphs 

1.  Interpretation 
accuracy 

2.  decision  quality 

Best  Disnlav:  | 

1.  No  effect/ 

No  effect 

2.  No  effect/ 
Line  graphs  are 
better 

j  Jarvenpaa  &  Dickson, 
1986  (13) 

Tables  vs.  Graphs 

1.  Retrieval  of  info. 

2.  Recall  info. 

3.  Message 
comprehension 

4.  Spotting  trends 

5.  Recall  large 
amounts  of  data 

Best  Displav: 

1.  No  effect 

2.  No  effect 

3.  No  effect 

4.  Graphs 

5.  Graphs 

Davis,  1989  (8) 

Tables  vs.  Graphs 

Performance 

Graphs  only 
better  when 
visual  cues  aid 
in  answering 
question. 

14 


In  an  attempt  to  understand  these  conflicting  results,  DeSanctis  wrote  the  paper, 
"Computer  Graphics  as  Decision  Aids:  Directions  for  Research"  (9).  This  paper  is 
instrumental  for  much  of  today’s  research  because  it  identifies  the  major  dependent 
variables  in  graphics  research  and  provides  a  rationale  for  their  use.  The  following  are  the 
major  dependent  variables  used  in  graphics  research  (9:468): 

(1)  Interpretation  Accuracy  -  Data  displayed  in  a  graph  should  be 
understood  by  the  reader. 

(2)  Problem  Comprehension  -  A  graph  has  dimensionality  which  provides 
a  "different"  and  "better"  perspective  on  the  data.  Understanding  of 
the  information  in  a  display  improves,  and  the  user  is  more  likely  to 
identify  problems  when  they  exist. 

(3)  Task  Performance  -  Because  comprehension  of  data  is  better, 
performance  on  a  task  involving  use  of  that  data  will  tend  to  improve. 

(4)  Decision  Quality  -  Because  the  user  can  better  understand  the 
problem,  the  individual  is  more  likely  to  make  a  good  decision. 

(5)  Speed  of  Comprehension  -  Graphs  have  a  summarizing  effect.  They 
reduce  information  overload. 

(6)  Decision  Speed  -  Because  the  information  can  be  comprehended 
faster,  the  time  required  to  make  a  decision  will  be  reduced. 

(7)  Memory  for  Information  -  Graphs  can  be  remembered  because  the 
spatial  aspect  of  a  graph  provides  additional  information  to  a  reader 
beyond  the  data  itself.  Information  serves  as  a  "cue"  during  recall. 

(8)  Viewer  Preference  -  The  spatial  aspect  of  a  graph  makes  it  visually 
appealing.  Special  features,  such  as  color,  shading,  realism  and 
complexity  can  be  added  to  a  graph  to  make  it  even  more  appealing  to 
the  reader. 

Collectively,  these  variables  are  the  basis  for  measuring  the  effectiveness  of  a  data 
presentation  format  in  experimental  research. 

The  experiment  for  this  thesis  considers  the  following  variables:  interpretation 
accuracy,  decision  speed  and  task  performance.  Tan  and  Benbasat  suggest  that  the  reason 
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for  the  conflicting  results  across  these  studies  is  the  lack  of  a  cumulative  approach  in 
research  effons.  They  believe  that  much  of  the  research  has  been  diverse  and  that 
researchers  do  not  consider  similar  variables  in  their  experiments  which  will  help  establish 
consistency.  Tan  and  Benbasat  identify  two  of  the  most  common  problems  with  the 
research: 

First,  there  are  problems  that  affect  the  internal  validity  of  findings 
such  as  poorly  designed  presentations,  poor  resolution  of  the 
medium  used,  or  the  confounding  of  multiple  effects  (e.g.,  colors 
with  graphics).  Second,  some  of  the  literature  tends  to  treat 
graphics  as  a  global  variable  and  fails  to  realize  that  differences 
among  various  graphical  forms,  such  as  lines,  bars,  or  pie  charts, 
might  account  for  the  contradictory  results.  (22:168) 

However,  the  most  important  problem  with  the  research  was  originally  cited  by 
Jarvenpaa,  Dickson,  and  DeSanctis  in  1985.  Tan  and  Benbasat  summarize  Jarvenpaa, 
Dickson,  and  DeSanctis’  findings  with  the  following  statement:  “The  major  cause  of 
contradictory  results  is  the  various  and  differing  tasks  used  in  these  experiments  and  the 
match  (or  mismatch)  between  the  task  [i.e.  the  action  to  be  performed  with  respect  to  the 
graph]  and  presentation  method  [i.e.  the  graph  format]”  (22:168).  In  light  of  these 
findings  Jarvenpaa,  Dickson,  and  DeSanctis  state  that  “future  research  efforts  will  keep 
producing  contradictory  results  unless  researchers  develop  some  type  of  taxonomy  of  task 
and  Stan  interpreting  the  results  within  the  taxonomy  (13:144)."  The  term  "taxonomy"  is 
defined  by  Webster  as,  "the  study  of  the  general  principles  of  scientific  classification" 

(27:1 195).  In  this  sense,  Jarvenpaa,  Dickson,  and  DeSanctis  are  challenging  researchers 
to  develop  a  method  for  characterizing  tasks. 

Several  studies  accomplished  since  1985  support  the  proposition  that  the  appropriate 
graphical  format  is  dependent  on  task  characteristics  (refer  to  Table  1).  For  example,  a 
study  performed  by  Dickson,  DeSanctis,  and  McBride  found  that  tables  were  more 
appropriate  for  tasks  that  required  an  accurate  interpretation  of  values.  On  the  other 
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hand,  they  showed  graphs  were  better  for  interpreting  trends  in  large  amounts  of  time 
>  dependent  data  or  fw  recalling  fairly  specific  facts  about  large  quantities  of  data  ( 10:46). 

Research  performed  by  Jarvenpaa  and  Dickson  also  supports  these  same  findings  (12:2). 

^  Another  study  that  supports  the  proposition  was  accomplished  by  Davis.  The  study 

developed  a  taxonomy  for  determining  relative  levels  of  task  complexities  and  examined 
whether  the  information  desired  by  the  decision  maker  was  a  task  characteristic  that 
affected  the  appropriateness  of  the  graphical  format.  Davis  concluded  “that  tabular 
presentations  are  an  effective  and  efficient  form  of  presentation  for  a  wide  range  of 
questions  while  graphical  forms  of  presentation  are  appropriate  for  a  limited  set  of 
questions”  (8:503).  Thus,  the  task  characteristic  is  an  important  variable  that  needs  to  be 
controlled  when  determining  the  appropriateness  of  the  graphical  format. 

One  of  the  most  important  task  characteristics  to  control  is  task  complexity,  the 
difficulty  of  extracting  an  answer  from  a  presentation.  Task  complexity  is  dependent  upon 
what  the  user  of  the  presentation  must  do  to  isolate  and  extract  the  relevant  information 
(8:499).  To  control  task  complexity,  it  is  important  to  be  able  to  measure  it.  This  is 
important,  because  if  the  experiment  is  designed  assuming  low  task  complexity,  and  the 
experiment  is  much  more  difficult  for  the  subjects  than  expected,  then  the  task  complexity 
could  then  have  an  affect  on  the  dependent  variables.  The  method  presented  by  Davis 
asserts  that  task  complexity  is  dependent  on  the  number  of  steps  taken  to  extract  the  data 
that  must  be  accomplished  to  “isolate  the  relevant  information”  (8:499).  In  a  study  Davis 
performed  with  Lauer,  Groomer,  Jenkins,  and  Yoo,  they  found  that  these  steps  are 
associated  with  several  different  types  of  activities.  The  activities  for  evaluating  task 
complexity  are  (in  increasing  order  of  complexity)  (8:499): 

( 1 )  Identifications  -  Identifying  a  line  on  a  line  graph  or  row  in  a  table. 

(2)  Scans  -  Locating  the  highest  points  on  a  line  in  a  line  graph. 
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(3)  Comparisons  -  Comparing  two  amounts  or  slopes. 

(4)  Estimations  -  Estimating  the  approximate  sum  or  difference  of  two  numbers. 
Thus,  by  counting  the  number  of  steps  that  are  required  to  perform  each  task,  the  relative 
complexity  of  the  task  can  be  determined.  Fch-  example,  to  extract  information  from  a  line 
graph  (scans),  the  subject  would  first  look  to  the  y-axis  and  compare  among  the  data  to 
see  which  entity  had  the  highest  point.  Then  the  subject  would  then  have  to  follow  this 
point  to  the  x-axis  to  obtain  the  correct  value  on  the  x-axis  which  will  answer  the 
question.  To  scan  this  data,  two  steps  were  taken  to  obtain  the  answer.  In  this  study,  task 
complexity  will  be  measured  using  the  method  advocated  by  Davis  as  stated  above. 

Another  task  characteristic  developed  by  Tan  and  Benbasat  (22)  utilizes  a  concept 
called  "anchoring"  to  formulate  a  taxonomy  for  characterizing  tasks  and  graphs.  These 
taxonomies  are  based  on  operational  defrnitions  of  x-value  anchoring,  y-value  anchoring, 
and  entity  anchoring.  Anchoring  is  defined  as  “the  phenomenon  that  specific  and  diverse 
parts  of  an  image  are  segmented  by  graph  readers  to  act  as  salient  and  relevant  cues,  or 
anchors,  when  extracting  different  classes  of  information  (e.g.,  x-value,  y-value,  and  entity 
information)  from  a  presentation"  (22:171).  In  other  words,  anchoring  is  the  technique 
readers  use  to  break  down  and  interpret  graphs. 

Anchoring  is  categorized  in  three  levels:  high,  medium,  and  low.  A  graph  has  high 
anchoring  if  it  provides  a  strong  visual  cue  to  the  information  in  question.  For  example,  a 
vertical  bar  chart  has  high  x-value  anchoring  because  bars  are  tied  to  a  discrete  value  on 
the  x-axis.  Thus,  the  x- value  can  easily  be  read  from  the  chart  without  having  to  make  any 
judgments. 

A  graph  has  low  anchoring  if  it  does  not  provide  a  visual  cue  to  the  reader.  A  line 
graph  is  a  good  example.  If  you  are  interested  in  determining  a  specific  value  of  x  for  a 
particular  point  on  the  graph,  then  you  must  perform  a  series  of  steps.  Because  a  line  is 
continuous,  the  reference  point  in  the  line  must  be  isolated  from  the  other  points,  then  that 


i 


0 
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point  must  be  projected  vertically  down  to  the  x-axis.  Finally,  the  value  of  the  x-axis  at 
>  the  projected  point  must  be  interpolated.  Because  these  steps  complicate  the  extraction  of 

data,  they  are  associated  with  low  anchoring.  Y-value  anchoring  is  essentially  the  same  as 
^  x-value  anchoring  except  that  it  refers  to  the  values  associated  with  the  y-axis. 

Entity  anchorinfi  is  somewhat  different,  because  it  refers  to  how  well  each  series  (an 
element  of  a  graph  legend)  can  be  distinguished  fiom  each  other.  For  example,  if  the 
performance  of  four  regions  (North,  South,  East,  and  West)  were  to  be  compared  over  a 
specific  period  of  time  then  each  of  these  regions  is  an  entity. 

Tan  and  Benbasat  suggest  that  bar  and  line  graphs  have  the  following  characteristics: 


Anchoring 

x-Value  Anchorine 

v-Value  Anchoring 

Entity 

Vertical  Bar 
Graphs 

High 

Moderate 

Low 

Line  Graphs 

Low 

Low 

High 

For  this  experiment,  it  is  necessary  to  also  apply  the  concept  of  anchoring  to  tables. 
Based  on  the  previous  discussion  of  anchoring  and  the  format  of  a  table,  it  is  reasonable  to 
assume  that  tables  have  the  following  anchoring  characteristics: 

X- Value  Anchoring  v- Value  Anchoring  Entity 

Anchoring 

Tables  High  High  High 

>  Tables  have  high  anchoring  in  all  three  categories  because  they  display  the  y-value  in  a 

row  and  column  matrix  which  gives  strong  visual  cues  to  the  x-value  (the  row  heading) 

^  and  entity  (the  column  heading). 
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Finally,  these  anchoring  characteristics  are  also  assumed  to  hold  true  for  the  three- 
dimensional  graphics  used  in  this  experiment.  This  is  a  reasonable  assumption  because  the  ^ 

three-dimensional  graphs  in  the  experiment  will  add  depth  in  the  third  dimension  for  only 
aesthetic  purposes,  and  do  not  provide  any  additional  information.  Before  these  anchoring 

t 

characteristics  of  graphs  and  tables  can  be  used  to  predict  which  mode  of  presentation  is 
appropriate  for  a  given  task,  tasks  must  also  be  defined  within  the  anchoring  framework 
(22:169-173). 

The  x-axis,  y-axis,  and  the  symbols  used  to  identify  entities  are  considered  graphical 
components.  Tan  and  Bendbasat  suggest  that  a  task  has  high  anchoring  for  a  component 
if  the  component  is  represented  in  the  question  as  either  a  given  value  or  an  unknown.  For 
example,  the  following  question  has  high  x-value  (x-axis)  and  high  y-value  (y-axis) 

anchoring:  “Company  A’s  revenues  in  period  two  are _ ?”  A  question  has  low 

anchoring  if  the  component  is  not  represented  in  the  question  as  a  given  or  unknown.  An 
example  of  a  question  that  has  low  x-value  anchoring  and  low  y-value  anchoring  is: 

“Which  company  has  the  largest  change  in  revenues  between  any  two  periods?”  Finally, 
questions  can  be  composed  of  a  mixture  of  high  x,  low  y;  or  low  x,  high  y-value 
anchoring.  An  example  of  a  question  that  has  a  high  x-value  anchoring  and  low  y-value 
anchoring  is:  “Are  company  A’s  revenues  from  period  five  to  seven  generally  increasing 
or  decreasing?"  (22:171). 

Conclusion 

Advanced  computer  packages  have  become  powerful  and  essential  tools  in 
communicating  information  to  decision-makers.  Graphics  have  become  an  important  i 

element  in  the  presentation  of  information  either  internally  or  to  the  public  (first 
investigative  question).  A  significant  amount  of  research  has  focused  on  the  effect  ^ 

graphical  format  has  on  an  individual's  decision.  Researchers  have  identified  criteria  that 
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help  standardize  graphs  and  reduce  the  risk  of  misinteipretation  by  the  user  (second 
>  investigative  question).  Also,  elementary  graphical-perception  tasks  have  been  identified 

to  improve  the  accuracy  with  which  graphical  information  can  be  interpreted.  Finally, 

^  there  has  been  a  significant  amount  of  research  that  has  attempted  to  identify  which  mode 

of  presentation  is  most  appropriate  for  a  given  task.  The  implication  of  this  research  is 
simple:  when  constructed  properly  for  a  particular  task,  graphs  are  an  accurate  and 
effective  tool  for  conveying  information  to  decision  makers.  Although  this  implication  is 
substantial,  it  only  addresses  the  usefulness  of  graphs  for  decision  support.  Furthermore, 
research  has  neglected  to  examine  the  effect  that  three-dimensional  graphs  have  on 
decision-making.  Thus,  this  study  will  examine  how  efficient  and  accurate  three- 
dimensional  graphs  are  with  respect  to  two-dimensional  graphs  and  tables. 

The  next  Chapter  (HI),  the  Methodology,  explains  and  justifies  the  experimental 
design,  pertinent  concepts,  construction  of  the  experimental  item,  procedures  for 
administering  the  experiment,  and  the  characteristics  of  sound  measurement.  It  also 
provides  an  in  depth  discussion  of  the  statistical  techiuques  used  to  justify  the  significant 
differences  in  the  accuracy  and  time  response  data. 
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ni.  Methodology 


This  chapter  describes  the  methodology  used  to  research  the  investigative  questions  f 

and  hypotheses  concerning  whether  or  not,  and  by  how  much,  three-dimensional  graphs 
are  more  efficient  and  accurate  than  two-dimensional  graphs  and  tables  when  presenting  ^ 

alternatives  to  decision-makers.  There  are  eleven  sections  in  this  chapter.  Section  one 
gives  a  brief  introduction  to  the  objectives  of  this  research  project  and  its  associated 
hypotheses  and  investigative  questions.  Section  two  discusses  the  within-subject  factorial 
design  with  repeated  measures  used  in  the  experiment.  Section  three  describes  how  the 
experimental  package  was  developed.  Section  four  explains  the  statistical  procedures 
used  to  analyze  the  results  of  the  experiment.  Section  five  discusses  the  characteristics  of 
sound  measurement.  Section  six  describes  the  construction  of  the  experimental  item. 

Section  seven  provides  a  reference  to  the  experimental  item  used  and  the  associated 
macros  and  code  developed  for  the  design  of  the  experiment  Section  eight  discusses  the 
procedures  for  administering  the  experimental  package.  Section  nine  explains  the 
experimental  procedures  for  administering  the  experiment  to  subjects.  Section  ten 
describes  the  development  of  the  End-of-Exercise  Questionnaire.  Finally,  section  eleven 
summarizes  the  chapter. 

Research  Questions 

The  primary  objective  of  this  study  is  to  determine  whether  or  not,  and  by  how  much, 
three-dimensional  graphs  are  more  efficient  and  accurate  than  two-dimensional  graphs  and 
tables  when  presenting  alternatives  to  decision-makers.  The  investigative  questions  which 

* 

relate  to  the  experiment  are  as  follows: 

3.  Do  various  modes  of  graphical  presentation  affect  the  accuracy  associated  with  given 

elementary  data  extraction  tasks?  ♦ 
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4.  How  efficient  are  the  various  modes  of  graphical  presentation  associated  with  given 
elementary  data  extraction  tasks? 

5.  Are  there  any  demographic  characteristics  of  the  participants  which  affect  their  ability 
to  efficiently  perform  elementary  data  collection  tasks? 

6.  Are  there  any  elementary  data  collection  tasks  in  which  three-dimensional  graphs 
facilitate  more  accurate  solutions  than  two-dimensional  graphs  and  tables? 

7.  Are  there  any  elementary  data  collection  tasks  in  which  three-dimensional  graphs 
facilitate  more  efficient  responses  than  two-dimensional  graphs  and  tables? 

8.  Which  graphical  format  is  appropriate  for  a  given  task? 

The  primary  null  hypotheses  (H©)  for  the  research  are: 

1 .  Manipulation  of  the  mode  of  presentation  and  task  anchoring  does  not  affect  the 
accuracy  of  data  interpretation. 

2.  Manipulation  of  the  mode  of  presentation  and  task  anchoring  does  not  affect  the 
response  time  of  data  interpretation. 

3.  The  level  of  graphics  training  does  not  affect  the  efficiency  of  decision  making. 

4.  The  rank  of  the  subjects  does  not  affect  the  efficiency  of  decision  making. 

5.  Gender  does  not  affect  the  efficiency  of  decision  making. 

6.  The  level  of  education  does  not  affect  the  efficiency  of  decision  making. 

Investigative  questions  one  and  two  were  addressed  in  the  literature  review  and  are 
answered  in  Chapter  II.  A  graphical  experiment  was  designed  using  a  microcomputer  to 
answer  investigative  questions  three  through  eight.  This  experiment  presented  a  business 
scenario  to  test  Air  Force  Institute  of  Technology  (AFTT)  Professional  Continuing 
Education  (PCE)  students.  The  experiment  attempted  to  determine  how  well  DoD 
decision  makers  perform  elementary  data  collection  tasks  using  various  graphs  or  tables. 
The  experiment  also  assessed  the  time  DoD  decision  makers  spent  completing  the  various 
iiKxies  of  presentation.  Once  questions  three,  four,  and  five  are  answered  (Chapter  4), 
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determining  whether  or  not  three-dimensional  graphs  are  better  than  two-dimensional 

graphs  for  particular  tasks  (questions  six,  seven  and  eight)  will  be  examined  (Chapter  5).  ^ 

Experimental  Design 

The  experiment  used  a  randomized  order  within-subject  factorial  design  with  repeated  * 

measures.  The  repeated  measures  portion  of  the  experimental  design  was  chosen  for  two 
main  reasons:  (1)  it  eliminated  the  experimental  bias  caused  by  variability  among  the 
subjects,  and  (2)  it  reduced  the  number  of  subjects  required  (29:517).  The  factorial  design 
was  also  chosen  because  of  the  need  to  analyze  the  main  and  interactive  effects  of  the 
three  experimental  variables,  mode  of  presentation,  anchoring  and  data-set.  "Information 
obtained  from  factorial  experiments  is  more  complete  than  that  obtained  from  a  series  of 
single  factor  experiments,  in  the  sense  that  factorial  experiments  permit  the  evaluation  of 
interaction  effects.  An  interaction  effect  is  an  effect  attributed  to  the  combination  of 
variables  above  and  beyond  that  which  can  be  predicted  from  variables  considered  singly" 

(28:309). 

Factorial  experiments  permit  the  researcher  to  make  decisions  that  have  a  broad  range 
of  applicability.  In  addition  to  information  about  how  the  experimental  variables  operate 
in  relative  isolation,  the  researcher  can  predict  what  will  happen  when  two  or  more 
variables  are  combined  with  one  another  (28:309). 

The  design  of  a  factorial  experiment  in  concerned  with  the  following  questions 
(28:310): 

1 .  What  factors  should  be  included? 

2.  How  many  levels  of  each  factor  should  be  included?  * 

3.  How  should  the  levels  of  the  factors  be  spaced? 

4.  How  should  the  experimental  units  be  selected?  * 

5.  How  many  experimental  units  should  be  selected  for  each  treatment  combination? 
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6.  What  steps  should  used  to  control  experimental  error? 

7.  What  criterion  measures  should  be  used  to  evaluate  the  effects  of  treatment  factors? 

8.  Can  the  effects  of  primary  interest  all  be  estimated  adequately  firom  the  experimental 

data  that  will  be  obtained. 

The  Experiment 

An  experiment  was  conducted  on  AFTT  PCE  students  to  test  how  well  DoD  decision 
makers  accurately  perform  elementary  data  collection  tasks,  and  to  measure  the  efficiency 
of  various  modes  of  presentation  (dependent  variables).  PCE  students  were  chosen  to 
participate  in  the  experiment  because  they  are  representative  of  DoD  decision  makers.  In 
addition,  they  were  an  extremely  accessible  source. 

The  factorial  experiment  was  designed  to  analyze  the  manipulation  of  three  factors  or 
independent  variables,  anchoring,  mode  of  presentation,  and  data-set  to  determine  their 
effects  on  the  response  variables  of  degree  of  accuracy,  and  response  time  (efficiency). 

A  factor  is  a  series  of  related  treatments  or  related  classifications.  The  number  of  levels 
within  the  factor  are  determined  by  the  degree  to  which  the  experimenter  desires  to 
investigate  each  factor  (28:31 1).  In  this  experiment  five  treatment  levels  were  selected  for 
mode  of  presentadon;  table,  two-dimensional  bar,  two-dimensional  line,  three-dimensional 
bar,  and  three-dimensional  line.  Four  treatment  levels  were  selected  for  task  anchoring: 
high  X,  high  y;  high  x,  low  y;  low  x,  high  y;  and  low  x,  low  y  value  anchoring.  The  third 
factor,  data-set  combination,  used  in  the  study  is  a  result  of  pilot  testing.  Despite  efforts 
to  disguise  the  data-set,  after  observing  twenty  graphs,  most  of  the  subjects  in  the  pilot 
test  realized  they  were  repeatedly  being  asked  the  same  four  questions  about  the  same 
data-set.  To  eliminate  this  source  of  experimental  bias,  an  additional  data-set  was  added 
to  create  two  unique  experimental  combinations. 

Tables  2  and  3  illustrate  the  two  data-set  combinations.  Both  tables  display  four 
levels  of  Anchoring  (c^  -  C4).  These  four  levels  of  anchoring  are  associated  with  high  x- 


25 


high  y,  high  x-low  y,  low  x-high  y,  and  low  x-low  y  tasks,  respectively.  Both  tables  also 
show  five  modes  of  presentation  (bi-b5).  These  modes  of  presentation  are  associated 
with  tables,  two-dimensional  bar,  three-dimensional  bar,  two-dimensional  line,  and  three 
dimensional  line,  respectively.  Two  data-sets  (ds- 1  and  ds-2)  comprised  each 
combination.  For  example,  ds-1  was  used  for  all  the  tables,  two-dimensional  bar,  and 
three-dimensional  line  charts/graphs,  and  ds-2  for  all  the  three-dimensional  bar  and  two- 
dimensional  line  graphs  for  data-set  combination  one  (Table  2).  Data-set  combination  two 
(Table  3)  utilized  the  opposite  data-sets  than  the  previous  data-set  combination. 


Table  2.  Data-Set  Combination  One. 


Mode  of  Presentation  fB') 

^3 

Task 

(HH) 

£1 

ds-1 

ds-1 

ds-2 

ds-2 

ds-1 

Anchorinc  fCl 

(HL) 

£2 

ds-1 

ds-1 

ds-2 

ds-2 

ds-1 

(LH) 

£3 

ds-1 

ds-1 

ds-2 

ds-2 

ds-1 

(LL) 

C4 

ds-1 

ds-1 

ds-2 

ds-2 

ds-1 

Table  3. 

Data-Set  Combination  Two. 

Mode  of  Presentation  IB) 

bl  ^  ^  b4 

b5 

Task 

(HH) 

ei 

ds-2 

ds-2 

ds-1  ds-1 

-.-2 

Anchorine  (O 

(HL) 

02 

ds-2 

ds-2 

ds-1  ds-1 

ds-2 

(LH) 

£3 

ds-2 

ds-2 

ds-1  ds-1 

ds-2 

(LL) 

£4 

ds-2 

ds-2 

ds-1  ds-1 

ds-2 
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The  three  factors,  anchoring,  mode  of  presentation,  and  data-set  combination  as  well 
as  their  associated  treatment  levels,  are  all  qualitative  variables  and  were  analyzed  as  such 
in  the  experiment 

Dimensions  of  a  factorial  experiment  are  indicated  by  the  munber  of  factors  and  the 
number  of  levels  of  each  factor.  The  dimensions  of  this  experiment  containing  three 
factors,  data-set  combination  (2  treatment  levels),  mode  of  presentation  (5  treatment 
levels),  and  task  anchoring  (4  treatments  levels),  and  is  described  as  a  2  x  5  x  4  (2  by  5  by 
4)  factorial  design.  The  treatment  combinations  for  the  2  x  5  x  4  design  are  represented  in 
Tables  4  and  5: 


Table  4.  Data-Set  Combination  One  (A). 


Mode  of  Presentation 

hi 

^3 

b4 

Task 

(HH) 

£1 

abciii 

abci21 

abcisi 

abci4i 

abcisi 

Anchoring  (O 

(HL) 

C2 

abcii2 

abci22 

abci32 

abci42 

abci52 

(LH) 

c3 

abciB 

abci23 

abci33 

abci43 

abcl53 

(LL) 

C4 

abcii4 

abci24 

abci34 

abci44 

abci54 

Table  5. 

Data-Set  Combination  Two  (A). 

Mode  of  Presentation  (B1 

hi 

h2 

b3  b4 

h5 

Task 

(HH) 

£1 

abc2ll 

abc221 

abc231  abc241 

abC25i 

Anchoring  tC) 

(HL) 

02 

abc212 

abc222 

abc232  abc242 

abc252 

(LH) 

03 

abc213 

abc223 

abc233  abc243 

abc253 

(LL) 

04 

abc214 

abc224 

abc234  abc244 

abc254 
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In  this  schematic,  bi  -  bs  represent  the  treatment  levels  of  mode  of  presentation,  ci 
C4  represent  the  treatments  levels  for  the  task  anchoring,  aj-  a2  represent  the  treatment  f 

levels  for  the  data-set  combination.  In  this  2x5x4  experiment,  forty  possible  treatment 
combinations  (a  x  b  x  c)  were  formed. 

r 

Finally,  level  of  complexity  was  the  one  control  variables  for  the  experiment  Since, 
task  complexity  can  be  a  confounding  variable  it  is  important  that  it  be  controlled.  This 
experiment  applied  low  task  complexity.  The  researchers  kept  the  experiment  simple. 

The  subjects  were  tasked  to  extract  data  directly  from  the  charts/  graphs.  They  were  not 
asked  to  manipulate  data  or  perform  mathematical  calculations  of  any  kind.  By  keeping 
complexity  low  the  results  will  be  more  generaUzable. 

Statistical  Analysis 

The  general  format  used  to  identify  differences  between  the  various  experimental 
treatment  means  was  the  Multifactor  Analysis  of  Variance  with  Repeated  Measures 
technique.  This  method  was  used  to  determine  the  main  and  interaction  effects  of  the 
mode,  task,  and  data  factors  on  the  response  time  when  the  subject  is  observed  under 
more  than  one  treatment  condition.  This  procedure  controls  the  differences  between 
subjects  that  are  often  quite  large  in  behavioral  studies  and  allows  a  comparison  between 
treatment  means  to  be  made. 

This  study  used  a  2  x  5  x  4  factorial  experiment  in  which  there  are  repeated  measure 
on  the  last  two  factors.  Table  6  illustrates  this  case: 


Table  6.  Repeated  Measures  Illustration.  4 


bl  b2  b3  b4  b5 

cl — c4  cl — c4  cl — c4  cl — c4  cl — c4 

al  G1---G1  G1---G1  G1---G1  G1---G1  G1--G1 

a2  G2---G2  G2---G2  G2---G2  G2---G2  G2---G2 


28 


There  are  31  subjects  in  each  group  (G).  Each  subject  is  observed  under  all  be 
^  combinations  of  factors  B  (mode)  and  C  (task),  but  only  under  a  single  level  of  factor  A 

(data  set  combination).  Thus,  there  are  2  groups  of  31  subjects  each  (62  subjects  in  all) 

^  and  there  are  be  (20)  observations  of  each  subject. 

The  linear  model  that  the  analysis  is  based  on  is  as  follows: 

’^aban  =  l‘  +  “a  +  Va)^Pa^“l*ab^P”am(a)*l'c-"  ^ 

“^ac-"  1”  cm(a)  ^bc  “Pl^abc-"  bcm(a)  ^(abem)-  ‘  ’ 

In  this  notation,  X  is  the  observed  response  and  is  a  function  of: 

(1)  p.  which  is  a  constant, 

(2)  a  which  represents  the  main  effect  of  the  factor  data-set  combination  (i  =  1, 2, 
where  1  =  the  first  data-set  combination,  2  =  the  second  data-set  combination), 

(3)  P  which  represents  the  main  effect  of  the  factor  mode  of  presentation  (j=  1, . . . , 
5,  where  1  =  table,  2  =  two-dimensional  bar  chart,  3  =  three-dimensional  bar 
chan,  4  =  two-dimensional  line  chan,  5  =  three-dimensional  line  chan), 

(4)  Y  which  represents  the  main  effect  of  the  factor  task  anchoring  (k  =  1, . . . ,  4, 
where  1=  High  X  -  High  Y  anchoring,  2  =  High  X  -  Low  Y  anchoring,  3  =  Low 
X  -  High  Y  anchoring,  4  =  Low  X  -  Low  Y  anchoring), 

(5)  7Cni(i)  which  is  the  effect  of  subject  m  that  is  nested  under  level  Oj, 

(6)  the  two-way  and  three-way  interactions  ap ,  p7i ,  ay ,  YJt ,  expY ,  and  Pyti , 
receptively  (28). 

Finally,  e  represents  the  experimental  error  term.  The  dummy  variable  "o"  indicates  that 
>  the  experimental  error  is  nested  within  the  individual  observation.  The  hypothesis  for  the 

linear  model  in  Equation  (1)  is  as  follows: 

'  Hq:  a  =  P  =  Y  =  7t  =  aP  =  P7c  =  aY=Yic  =  apY=PY7C  =  0 

H^:  At  least  one  of  the  effects  is  not  equal  to  zero. 
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The  analysis  of  variance  for  this  experiment  takes  the  form  shown  in  Table  7  (28:540): 


Table  7.  Summary  of  Analysis  of  Variance. 


Source  of  Variation 

-flL 

E(Ms) 

Between  Subiects 

na-l 

A 

a-1 

CT®  +  bca,  +  nboa^ 

Subject  within  groups 

a(n-l) 

<Je  +  bca^, 

[error  (a)] 

Within  subiects 

nafbc-1') 

B 

b-1 

o^-Hca^+naoa^ 

AB 

(a-l)(b-l) 

(j^  +  co^-i-ncCT^b 

o  o 

B  X  subject  within  groups 

'a(n-l)(b-l) 

[error  (b)] 

C 

c-1 

Cl  +  ba^  +  nabor^ 

AC 

(a-l)(c-l) 

cl  +  hc%  +nba^ 

C  X  subject  within  groups 

a(n-l)(c-l) 

[error  (c)] 

BC 

(b-l)(c-l) 

ABC 

(a-l)(b-l)(c-l) 

BC  X  subject  within  groups 

a(n-l)(b-l)(c-l) 

[error  (be)] 


The  manner  in  which  the  total  variation  is  partitioned  in  Table  7  is  quite  similar  to  that 
used  in  an  a  X  b  X  c  factorial  experiment  with  no  repeated  measures.  However,  in  an 
experiment  having  repeated  measures,  the  within-cell  variation  is  divided  into  two  non- 
overlapping  parts  (refer  to  Figure  3).  "One  part  is  a  function  of  experimental  error  plus 
the  main  effects  of  subjects  within  groups,  i.e.,  individual  differences.  The  other  part  is  a 
function  of  experimental  error  and  B  x  subject-within-group  interaction"  (29:520). 
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Figure  3.  Schematic  Representation  of  the  Analysis  of  Variance  (28:266). 


The  ANOVA  was  used  to  analyze  differences  in  treatment  means  associated  with  the 

experimental  variables  mode,  task,  and  data  set  combination.  The  F  test  is  used  to  test 

whether  or  not  there  are  any  statistical  differences  in  the  factor  level  means.  The  expected 

values  of  mean  squares  shown  in  the  Table  7  indicate  the  appropriate  F  ratios  to  be  used  in 

2 

making  statistical  decisions.  For  example,  to  test  the  hypothesis  that  *^0=0, 


F  = 


MS 


MS, 


vubj  within  groups 


(2) 


The  denominator  of  Equation  (2)  is  commonly  referred  to  as  the  mean  square  error 

2 

between  groups.  To  test  the  hypothesis  that  =  0  ,  the  appropriate  F  ratio  is 


MS 


abc 


MSb, 


IC  X  sulg  within  groops 


(3) 


The  denominator  in  Equation  (3)  is  commonly  referred  to  as  the  means  square  error 
within  "since  it  forms  the  denominator  of  F  ratios  used  in  testing  the  effects  which  can  be 
classified  as  part  of  the  within  subject  variation"  (29:521).  Large  values  of  F  support  the 
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alternative  hypothesis,  because  the  numerator  will  be  larger  than  the  denominator  if  the 
hypothesis  is  false.  Values  of  F  close  to  1  support  the  null  hypothesis,  since  the  numerator 
and  denominator  have  the  same  expected  value  if  the  hypothesis  is  true  (20:547). 

The  validity  of  this  experiment  is  based  on  several  assumptions.  The  first  assumption 
is  that  the  observations  represent  random  samples  from  the  population.  This  assumption 
was  met  by  randomly  assigning  the  subjects  to  the  two  test  groups  and  randomizing  the 
order  in  which  each  subject  received  the  treatments.  The  second  assumption  is  that  the 
observations  are  drawn  from  a  normally  distributed  population.  To  satisfy  this  assumption 
the  response  times  were  transformed  using  the  natural  logarithm.  The  Wilk-Shapiro/ 
Rankit  Plot  was  used  to  validate  normality.  The  other  assumptions  are  "about  the  form  of 
the  variance-covariance  matrix  associated  with  the  joint  multivariate  normal  distribution  of 
the  random  variables  in  the  model"  (29:517).  Specifically,  the  variance-covariance 
matrices  of  factor  A  must  be  homogeneous,  and  the  covariance  terms  of  the  common 
variance-covariance  matrix  must  be  equal.  The  last  condition  is  known  as  the  assumption 
of  circularity.  These  two  assumptions  were  tested  via  the  procedures  described  in  Winer 
(29:515-517).  Because  these  procedures  involve  complex  equations  and  tedious  matrix 
calculation  they  will  not  be  discussed,  however,  the  calculations  will  be  shown  in  the  next 
chapter. 

The  icsults  of  these  test  indicate  that  the  variance-covariance  matrices  do  not  meet 
the  homogeneity  and  circularity  criteria.  "If  the  usual  F  is  used  and  the  assumptions  have 
been  violated,  a  positive  bias  results  an  the  analysis  of  variance  hypothesis  will  be  rejected 
more  often  than  the  true  state  of  affairs  warrants  for  the  nominal  level  of  significance" 
(29:520).  In  this  situation,  Winer  recommends  using  a  more  conservative  F  test.  Table  8 
indicates  the  usual  test  and  the  more  conservative  test  used  in  the  analysis. 
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Tables.  F  Ratio  Critical  Values 


Oalifi 


X  subject  within  group 


X  subject  within  group 


X  X  subject  within  group 


X  subject  within  group 


Usual  Fj  ^[(b-l),a(n-l)(b-l)] 

Conservative  Fj  ^[l,a(n-l)] 

Usual  Fj_J(a-l)(b-l),a(n-l)(b-l)] 

Conservative  F^  ^[(a-l),a(n-l)] 

Usual  Fj_  J(c-l),a(n-l)(c-l)] 

Conservative  Fj  ^[l,a(n-l)] 

Usual  Fj  _  ^[(a  -  l)(c  -  l),a(n  -  l)(c  - 1)] 

Conservative  Fj_^[(a-l),a(n-l)] 

Usual  Fj .  a[(b  -  l)(c  •  l),a(n  -  l)(b  -  l)(c  - 1)] 


- 

^C  X  subject  within  group 

Conservative  Fj  _  ^  [l,  a(  n  - 1)] 

— - -  Usual  Fj  _  ^[(a  -  l)(b  -  l)(c  - 1),  a(n  - 1)( b  -  l)(c  - 1)] 

oC  X  subject  within  group 

Conservative  Fj  [(a  -l).a(n-l)] 


The  level  of  significance  was  set  at  .05  for  all  test.  If  a  p- value  was  obtained  which 
was  less  than  or  equal  the  stated  level  significance  the  null  hypothesis  was  rejected  with  a 
>  level  of  confidence  of  95  percent 

The  following  example  will  show  the  computational  procedures  used  for  the 
,  Multifactor  ANOVA  with  Repeated  Measures.  "With  the  exception  of  the  breakdown  of 

the  within-cell  variation,  the  computational  procedures  are  identical  to  those  of  an  a  x  b  x 
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c  factorial  experiment  having  n  observations  per  cell"  (16:546).  The  computational 
procedures  will  be  illustrated  through  an  example  analysis  of  a  2  x  3  x  3  factorial 
experiment  with  repeated  on  the  last  two  factors  given  to  6  subjects.  This  example  was 
developed  by  Winer  and  uses  the  data  in  Table  9. 

Table  9.  Basic  Data  for  Numerical  Example. 


■ 

Subiects 

b1 

b2 

b3 

Total 

C2 

c3 

C2 

C3 

cl 

C2 

c3 

1 

45 

53 

60 

40 

52 

57 

28 

37 

46 

418 

al 

2 

35 

41 

50 

30 

37 

47 

25 

32 

41 

338 

3 

60 

65 

75 

58 

54 

70 

40 

47 

50 

519 

4 

50 

48 

61 

25 

34 

51 

16 

23 

35 

343 

a2 

5 

42 

45 

55 

30 

37 

43 

22 

27 

37 

338 

6 

56 

60 

77 

40 

39 

57 

31 

29 

46 

435 

Group  1  (Gl)  consists  of  subjects  1, 2,  and  3,  and  group  (G2)  consists  of  subjects  4, 5, 
and  6.  To  relate  this  example  to  our  experiment,  assume  A  is  the  data-set  combination 
factor,  B  is  the  mode  of  presentation  factor,  C  is  the  task  anchoring  factor,  and  the  data  is 
the  response  time  of  the  subject.  For  example,  subject  3  had  response  time  of  58, 54,  and 
70  seconds,  respectively,  when  performing  the  level  3  task  at  level  2  of  the  mode  of 
presentation  factor. 

To  aid  in  the  calculation  of  the  sums  of  squares  for  the  ANOVA  table,  Winer 
suggests  the  following  summary  tables  be  created  (Table  10). 
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Table  10.  Summaiy  Tables  for  Numerical  Example. 


ABCS 


imi 


a1 

a2 


Total 


b1 

C1 

C2 

C3 

140 

159 

185 

148 

153 

193 

288 

312 

378 

b2 

C2 

c3 

128 

143 

174 

95 

110 

151 

223 

253 

325 

AC  Summary  table 


bl 

b2 

b3 

Total 

al 

484 

445 

346 

1275 

a2 

494 

356 

266 

1116 

Total 

978 

801 

612 

2391 

al 

a2 


Total 


Cl 

c2 

c3 

361 

418 

496 

312 

342 

462 

673  760  958  2391 


B  X  Subi.  Within  G2  Summary  Table 


Subject 

bl 

b2 

b3 

1 

158 

149 

111 

418 

2 

126 

114 

98 

338 

3 

200 

182 

137 

519 

Total 

484 

445 

346 

1275 

4 

5 

6 


Total 


b1 

b2 

b3 

159 

110 

74 

142 

110 

86 

193 

136 

106 

494 

356 

266 

35 


Table  10.  Summaiy  Tables  for  Numerical  Example  (continued). 


C  X  Subi.  Within  G1  Summary  Table  C  x  Subi.  Within  G2  Summary  Table 


C2 

c3 

ESI 

4 

91 

105 

147 

343 

5 

94 

109 

135 

338 

6 

127 

128 

180 

435 

Total 

312 

342 

462 

1116 

cl 

C2 

c3 

Total 

1 

113 

142 

163 

418 

2 

90 

110 

138 

338 

3 

158 

166 

195 

519 

Total 

361 

418 

496 

1275 

Table  11.  ANOVA  Table  Equations  and  Numerical  Example. 


(1)  =  G^/nabc 

(2) =  IX^ 

(3) =  (iaI)i  nhc 

(4) =  (iB^j/nac 

(5) =  (ic2)/nab 

(6) = 

(7) =  j/nb 

(8) = 

(9)=  j/n 

(10)=  (lP^)/bc 


=  (2391)2/(3*2*3*3) 

=  452  +532  +6O2+...+292  +  452 

=  (l2752  +  11162)/(3*3*3) 

=  (9732 +80)2 +6122)/ (3*  2*  3) 
=  (5732  +  76o2  +  9582)  /  (3  *  2  *  3) 
=  (4342  +  4452 +.  •  .+2662 )  /  (3  *  3) 
=  (36i2  +  4182+. .  -  44622 )  /  (3  *  3) 
=  (2882  +3122+... +2552)/(3*2) 
=  (i402+1592+...+1182)/3 
=  (4132  +3332+... +4352)/(3*3) 

=  (1532 +  1492 +...+1062)/3 
=  (1132 +1422 +...+18o2)/3 


=  105,868.17 
=  115,793.00 
=  106,336.33 

=  109,590.50 

=  108,238.50 

=  110,391.67 
=  108,757.00 
=  111,971.50 

=  112,834.33 
=  108,827.44 
=  113,117.67 

=  111,353.67 


f 
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Using  the  values  from  the  summary  tables  in  the  12  equations  in  Table  1 1  can  be  easily 
computed.  These  12  equations  provide  the  basis  for  calculating  the  sums  of  squares  for 
the  ANOVA  table.  Table  12  shows  how  to  calculate  the  appropriate  sums  of  squares  by 
algebraically  combining  the  results  of  various  equations  from  Table  1 1. 

Table  12.  Sums  of  Squares  Calculations. 


Source  of  Variation 

Computation  Formula 

_ss_ 

Between  Subiects 

aQ)--.CD 

2959.27 

A 

(3)-(l) 

468.16 

Subject  within  groups 
[error  (a)] 

(10)-(3) 

2941.11 

Within  subiects 

(2)-(10) 

6965.56 

B 

(4)-(l) 

3722.33 

AB 

(6)-(3)-(4)+(l) 

333.00 

B  X  subject  within  groups 
[error  (b)] 

(ll)-(6)-(10)+(3) 

234.89 

C 

(5)-(l) 

2370.33 

AC 

(7)-(3)-(5)+(l) 

50.34 

C  X  subject  within  groups 
[error  (c)] 

(12)-(7)-(10)+(3) 

105.56 

BC 

(8)-(4)-(5)+(l) 

10.67 

ABC 

(9)-(6)-(7)-(8)+(3)+(4)+(5)-(l) 

11.32 

BC  X  subjects  within  groups 
[error  (be)] 

(2)-(9)-(ll)-(12)+(6)+(7)+(10)-(3) 

127.11 

The  sums  of  squares  from  Table  12  are  used  to  calculate  the  Mean  Squares  in  the 
ANOVA  table.  The  Mean  Squares  are  then  used  to  form  the  F  ratios  to  test  the 
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hypothesis  that  °a  ~  "  °y  ~  °ap  “  °ocy  “  ^  °apy  ~  ®  .  Table  13  presents  the  summary 

ANOVA  table  for  the  example  data.  Significant  F  ratios  are  emphasized  with  asterisks. 


Table  13.  Summary  of  Analysis  of  Variance. 


Source  of  Variation 

_SS_ 

-dL 

_MS- 

Between  Subiects 

2959.27 

5 

A 

468.16 

1 

468.16 

0.75 

Subject  within  groups 
[error  (a)] 

2941.11 

4 

622.78 

Within  subiects 

6965.56 

48 

B 

3722.33 

2 

1861.16 

63.39* 

AB 

333.00 

2 

166.50 

5.67* 

B  X  subject  within  groups 
[error  (b)] 

234.89 

8 

29.36 

C 

2370.33 

2 

1185.16 

89.78* 

AC 

50.34 

2 

25.17 

1.91 

C  X  subject  within  groups 
[error  (c)] 

105.56 

8 

13.20 

BC 

10.67 

4 

2.67 

0.34 

ABC 

11.32 

4 

2.83 

0.36 

BC  X  subjects  within  groups 

127.11 

16 

7.94 

[error  (be)] 


This  ANOVA  tables  shows  that  the  main  effects  of  factors  B  and  C  are  significant.  The 
AB  interaction  effect  is  also  shown  to  be  significant  Again,  these  computational 
procedures  will  be  used  to  perform  the  variance  analysis  of  the  experiment 

Neter,  Wassermann  and,  and  Kutner  (16:634)  provide  a  method  for  determining  the 
power  of  an  F  test.  The  Power  is  the  probability  that  the  null  hypothesis  (Ho)  is  rejected 
when  the  alternative  hypothesis  (Ha)  is  true.  Neter,  Wassermann  and,  and  Kutner  state 
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that  the  power  of  the  F  test  is  the  probability  that  F*>F(1  -  a;  r  - 1;  n  -  r)/<|)  ,  where  ())  is 
the  non-centrality  parameter,  a  measure  of  how  unequal  the  pj  are,  defined  by: 


where: 


To  determine  the  power  probabilities  requires  the  use  of  the  Pearson-Hartley  charts 
provided  by  Neter,  Wassermann  and,  and  Kumer  (16).  These  charts  contain  several 
power  curves  for  the  F  test.  Determination  of  the  power  of  the  F  test  from  these  charts 
requires  the  following  parameters:  degrees  of  freedom  for  the  numerator  and  denominator, 
level  of  signifrcance,  and  the  non-centrality  parameter.  The  power  of  the  F  tests  used  for 
the  analysis  of  variance  in  this  thesis  are  above  99  percent.  Calculations  for  the  power  test 
are  located  in  Appendix  F. 

If  the  analysis  of  variance  returns  a  significant  finding,  the  next  step  in  the  statistical 
analysis  is  to  perform  a  comparison  of  means.  The  Tukey  method  was  used  for  all 
"pairwise  comparisons  of  factor  level  means;  in  other  words,  the  family  consists  of 
estimates  of  all  pairs”  (16:580).  The  Tukey  method  requires  a  family  confidence 
coefficient  of  1-a  which  makes  the  confidence  coefficient  for  the  each  pairwise  test 
larger  than  1-a  .  The  Tukey  method  for  contrast  of  treatment  means  utilizes  the 
studentized  range  distribution  (q).  The  contrast  have  the  following  form  when  there  is 
significant  three  level  interaction: 

L±Ts{l}  (6) 
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where: 


(7) 


s^{l}=^IXi4  ® 

T  =  -^q[l-a.r,dfofMSq.  (9)  ^ 

V2 

In  Equations  (6)  -  (9),  r  is  the  number  of  comparisons  being  made  and  c  is  a  matrix  of 
positive  and  negative  ones  arranged  in  a  manner  that  all  pairwise  comparisons  of  treatment 
means  can  be  made.  Finally,  in  a  repeated  measures  experiment  the  error  is  partitioned 
into  different  components.  It  is  important  that  the  appropriate  error  term  be  used.  From 
Table  13,  the  error  for  three  way  interaction  is  MSBC  x  subjects  within  groups  [error 
(be)].  Thus,  MSBC  x  subjects  within  groups  would  be  used  instead  of  MSE  in  this  case. 

Equations  (6)  -  (9)  are  used  when  there  is  significant  three  way  interaction.  However, 
there  may  be  cases  when  there  only  two-way  interactions  which  involve  taking  the  means 
of  mabc  over  one  of  the  factors.  For  example,  take  the  case  when  there  are  only  BC 
interactions,  then  there  is  only  interest  in  contrast  of  the  m.bc  means.  In  this  special  case 
the  estimator  and  estimated  variance  for  contrast  of  the  treatment  have  the  following  form: 

L  =  =  0  (10) 

s2{l}=^IIc2.  (11) 

na  ^ 

Again  MSBC  x  subjects  within  groups  would  be  used  instead  of  MSE  in  this  case. 

Choosing  the  correct  error  term  for  the  contrast  of  means  is  a  relatively  simple  task.  f 

However,  care  must  be  taken  when  the  comparison  being  made  are  between  subjects 
groups.  For  example,  “  ^2b.  has  a  estimated  variance  composed  of  both  between 
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subject  group  and  within  subject  group  error.  The  estimated  variance  has  the  following 
fwm: 


SS  +SS 

2  (f  j  _  subject  within  groups  B  x  subject  within  group 
nc[a(n  - 1) + a(n  -  l)(b  - 1)] 


ZIc 


ab‘ 


(12) 


On  the  other  hand,  ^al  ^a2.  has  an  estimated  variance  composed  of  only  error 
associated  with  factor  B, 


X  subject  within  group 


nc 


ab‘ 


(13) 


The  final  area  of  the  statistical  analysis  was  accomplished  on  the  accuracy  scores. 
Because  of  the  dichotomous  nature  of  the  accuracy  scores  based  on  the  frequency  count 
of  correct  answere,  the  Chi-squared  statistic  was  use  to  analyze  the  data.  The  Chi- 
squared  statistic  was  applied  to  a  contingency  table  that  shows  the  observed  frequencies 
for  each  treatment.  According  to  Shao  "this  type  of  test  will  tell  us  whether  or  not  the 
two  basis  of  classification  used  respectively  in  rows  and  columns  of  a  contingency  table 
are  independent  (or  not  related)  (19:428)."  The  Statistix  software  package  was  used  for 
this  analysis.  If  the  calculated  Chi-squared  statistic  is  significant  enough  to  reject  the  null 
hypothesis,  then  a  cell  by  cell  comparison  of  the  proportions  is  utilized  to  identify  where 
there  are  significant  differences. 

Characteristics  of  Sound  Measurement 

Emory  states  that  there  are  three  major  considerations  researchers  should  use  in 
evaluating  a  measurement  tool.  They  are  validity,  reliability  and  practicality  (1 1:179). 

Validity  refers  to  the  extent  to  which  a  test  measures  what  we 
actually  wish  to  measure.  Reliability  has  to  do  with  the  accuracy 
and  precision  of  measurement  procedure . Practicality  is 
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concerned  with  a  wide  range  of  factors  of  economy,  convenience, 

and  inteqnetability.  (11:179) 

There  are  two  major  varieties  of  validity,  external  and  internal,  to  be  considered.  Internal 
validity  is  concerned  with  the  conclusions  drawn  from  an  experiment,  and  if  there  is  a 
causal  relationship.  External  validity  is  concerned  with  the  observed  causal  relationship 
and  if  this  relationship  is  generalizable  across  persons,  settings  and  times  (1 1 :424). 

Internal  Validity.  Internal  validity  is  also  the  ability  of  a  research  instrament  to 
measure  what  it  is  suppose  to  measure.  The  seven  major  threats  to  internal  validity  are  as 
follows  (11:424-425): 

(1)  History-  events  might  occur  that  may  confound  the  effects  of  the  experiment 
and  confuse  the  relationship  being  studied. 

(2)  Maturation  -  a  concern  when  the  experiment  is  run  for  or  over  a  long  period 
of  time,  but  may  also  be  a  factor  for  short  experiments.  Changes  may  take 
place  with  the  subjects  taking  the  experiment  that  are  not  specific  to  any 
particular  event 

(3)  Testing  -  taking  multiple  tests  can  have  a  learning  effect  which  influences  the 
results  of  subsequent  testing. 

(4)  Instrumentation  -  a  threat  that  results  from  changes  between  observations,  in 
the  measuring  instrument  or  the  observer. 

(5)  Selection  -  the  specified  selection  of  subjects  to  experimental  and  control 
groups.  Validity  consideration  requires  that  experimental  and  control  groups 
be  equivalent  in  every  respect 

(6)  Statistical  Regression  -  research  groups  have  been  selected  based  on  previous 
scores  which  may  be  extreme. 

(7)  Experiment  Mortality  -  a  problem  occurs  when  the  composition  of  the  original 
research  groups  change  during  the  experiment 


These  seven  threats  are  generally,  but  not  always,  adequately  dealt  with  in 
randomized  experiments  (11 :426).  This  experiment  used  a  randomized  order  within- 
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subject  factorial  design  with  repeated  measures.  The  seven  major  threats  to  internal 
»  validity  were  considered  during  the  construction  of  the  experimenL 

History  was  not  a  threat  consideration  because  each  subject  was  only  tested  once,  in  a 
^  computer  laboratory  with  a  maximum  of  fifteen  participants.  Each  subject  took  no  longer 

than  fifteen  minutes  to  complete  the  experiment  Subjects  were  given  direction  prior  to 
the  experiment  only,  and  had  no  prior  knowledge  of  the  test  and  its  associated  objectives. 
Participants  did  not  leave  the  computer  laboratory  until  after  they  had  completed  the 
experiment.  If  there  were  any  historical  events  that  may  have  occurred,  each  participant 
was  subjected  to  the  same  event. 

Maturation  was  not  a  factor,  first,  because  the  subjects  participated  on  only  a 
voluntary  basis.  Second,  the  lengtii  of  the  test  was  a  maximum  of  fifteen  minutes.  Third, 
the  subjects  participated  in  the  experiment  either  in  the  early  morning  or  shortly  after  lunch 
and  should  not  have  been  tired  nor  hungry.  Fourth,  they  were  told  upfront  there  would  be 
a  maximum  of  twenty-five  graphic  questions  and  seventeen  demographic  questions. 
Therefore  they  did  not  have  to  speculate  on  the  number  of  questions  or  on  the  length  of 
the  test.  This  should  have  helped  preclude  boredom.  Finally,  in  the  end-of  exercise 
questionnaire  section  (seventeen  demographic  questions),  the  subjects  were  asked  what 
their  level  of  interest  was  in  the  experiment.  Ninety-seven  percent  of  the  responses  ranged 
from  moderate  (level  4)  to  very  high  (level  7). 

Testing  was  not  a  consideration  because  each  of  the  64  subjects  participated  in  the 
experiment  only  once  in  the  same  computer  laboratory  environment.  Therefore,  there  was 
no  learning  effect  fiom  taking  multiple  tests. 

Instrumentation  should  not  be  a  threat  consideration  because  each  of  the  experiments 
was  conducted  on  the  same  type  of  386  microcomputer  using  a  Quattro  Pro  graphics 
software  package,  in  the  same  laboratory  environment,  with  the  same  two  monitors. 
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Selection  should  also  not  be  a  factor  because,  each  of  the  subjects  were  randomly 
assigned  to  each  computer  terminal  and  given  the  same  twenty-five  graphs  to  analyze  and 
respond  to.  The  graphs,  with  the  various  treatment  combinations,  for  each  participant, 
were  randomly  ordered  by  the  computer  software.  "If  subjects  are  randomly  assigned  to 
experimental  and  control  groups,  this  selection  problem  can  be  largely  overcome" 
(11:425). 

Statistical  Regression  was  not  a  threat  consideration  because  the  participants  were 
only  tested  once  in  the  same  environment  and  had  not  been  pre-selected  based  on  previous 
scores  on  the  test. 

Experiment  Mortality  was  not  a  consideration  because  each  of  the  subjects  were 
volunteers  who  participated  in  an  experiment  with  a  maximum  length  of  fifteen  minutes 
only  once.  Therefore,  the  composition  of  the  research  group  did  not  change. 

External  Validity.  "External  validity  is  concerned  with  the  interaction  of  the 
experimental  stimulus  with  other  factors  and  the  resulting  impact  on  abilities  to  generalize 
to  (and  across)  times,  settings,  or  persons"  (1 1:427).  The  three  major  threats  to  external 
validity  are  as  follows  (1 1:427-428): 

(1)  Reactivity  of  Testing  on  X  -  sensitizing  subjects  during  the  pretest,  so  they 
respond  differently  when  they  are  given  the  actual  experiment. 

(2)  Interaction  of  Selection  and  X  -  the  population  the  participants  are  selected 
from  may  not  be  the  population  to  which  results  are  to  be  generalized. 

(3)  Other  Reactive  Factors  -  the  experimental  setting  may  have  a  biasing  effect  on 
the  subjects  responses.  The  experimental  setting  may  not  be  realistic  or 
representative  of  the  actual  setting  of  the  generalized  population.  If  the 
subjects  are  aware  there  is  an  experiment  being  conducted,  they  may  role-play 
to  distort  the  effects. 

"Problems  of  internal  validity  are  amenable  to  solution  by  the  careful  design  of 
experiments,  but  this  is  less  tme  for  external  validity"  (1 1:428).  External  validity  is  mainly 


generalization,  and  is  an  inductive  process  of  extrapolating  beyond  the  actual  data 
collected  (11:428). 

Reactivity  of  Testing  on  X  was  not  a  threat  consideration  because  an  experimental 
^  pretest  was  not  conducted. 

Interaction  of  Selection  and  X  was  reduced  by  randomly  assigning  the  voluntary 
participants  to  the  two  data-set  combinations  incorporating  the  associating  treatment  level 
combinations.  AFTT  Professional  Continuing  Education  (PC!E)  students  volunteered  to 
participate  in  this  study.  PCE  students  were  chosen  because  of  their  broad  and  diverse 
backgrounds.  Question  IS  in  the  end-of  exercise  questionnaire  asked  which  areas  they 
considered  to  be  the  primary  basis  for  their  professional  experience.  The  subjects  were 
experienced  in  the  following  areas:  technical,  scientific,  engineering,  operational,  financial, 
managerial,  contracting,  and  logistics.  The  experiment  is  trying  to  determine  the  affect  of 
graphics  on  the  decision  maker.  The  backgrounds  associated  with  the  subjects  aU  require 
decision-making  at  various  level.  Therefore,  the  results  of  the  experiment  should  be 
applicable  to  the  generalized  population  of  managers,  leaders  and  decision  makers. 

The  Other  Reactive  Factors  were  controlled  by  placing  the  experiment  on  a 
microcomputer.  Although  the  subjects  realized  they  were  participating  in  an  experiment, 
they  did  not  realize  the  time  to  complete  each  of  the  graphs  was  being  automatically 
recorded.  Therefore,  they  did  not  feel  encouraged  to  compete  against  the  clock.  The 
subjects  were  also  observed  to  ensure  they  diligently  worked  through  the  experiment  and 
were  not  distracted.  The  monitors  observed  no  distracted  behavior.  To  relieve  any 
anxiety  the  participants  may  have  had  working  on  a  computer,  the  experiment  was 
automated  to  the  full  extent  possible.  The  subjects  entered  their  response  by  pressing  the 
corresponding  number  key  on  the  keyboard  (no  mouse  was  used).  If  they  type  a  number 
other  than  in  the  correct  range,  then  they  were  given  another  chance  to  respond 
appropriately.  After  they  entered  an  appropriate  response,  the  computer  displayed  the 
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next  graph  and  question.  This  procedure  greatly  reduced  the  subjects  anxiety  that  they 

may  do  something  wrong.  ^ 

Reliability.  "A  measure  is  reliable  to  the  degree  that  it  supplies  consistent  results. 

Reliability  is  a  contributor  to  validity  and  is  a  neces^ry  but  not  sufficient  condition  for 

* 

validity"  (1 1:185).  Reliability  is  concerned  with  estimates  in  which  a  measurement  is  free 
of  random  error.  Reliable  instmments  are  robust  because  they  work  well  at  different  times 
and  under  different  conditions.  The  three  perspectives  that  are  typically  used  to  measure 
reliability  are  as  follows  (11:185-186): 

(1)  Stability  -  occurs  if  you  can  obtain  consistent  results  with  repeated 
measurements  of  the  same  person  with  the  same  instrument.  Stability 
measurements  are  more  difficult  and  not  as  beneficial  in  survey  situations  as 
for  observation  studies.  Stability  is  concerned  with  personal  and  situational 
fluctuations  fiom  one  time  to  another. 

(2)  Equivalence  -  considers  how  much  errcn-  may  be  introduced  by  different 
observers  or  different  samples  of  items  being  studied.  Equivalence  is 
concerned  with  variations  at  one  point  in  time  among  observers  and  samples 
of  items.  If  subjects  are  classified  the  same  way  by  each  test,  then  the  tests  are 
said  to  have  good  equivalence. 

(3)  Internal  Consistency  -  this  approach  uses  only  one  administration  of  an 
instrument  or  test  to  determine  consistency  or  homogeneity  among  the  items. 

Techniques  such  as  the  split-half  can  be  used  to  determine  if  the  similar 
questions  and  statements  to  both  halves  have  similar  responses  and  if  there  is  a 
correlation. 

The  perspective  of  stability  cannot  be  used  to  measiu’e  reliability  because  repeated 
measurements  cannot  realistically  be  obtained.  Due  to  the  limited  time  frame  allocated  for 
this  thesis  process  (10  months)  and  the  various  DoD  resources  (PCE  students)  used  in  the 
experiment,  a  duplication  of  this  effort  is  practically  impossible.  Also,  the  longer  the  time  ^ 

span  between  tests,  the  greater  the  chance  outside  factors  will  contaminate  the 
measurement  and  distort  the  stability.  Because  of  this  fact,  more  interest  has  been  focused  ♦ 

on  equivalence  (1 1:186). 
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The  equivalence  perspective  measures  the  degree  to  which  alternative  fonns  of  the 
same  measure  produce  same  or  similar  results  (1 1: 188).  The  test  for  item  sample 
equivalence  uses  alternative  or  parallel  forms  of  the  same  test  that  is  administered  to  the 
same  person  simultaneously  (11:1 86).  Alternate  or  parallel  forms  of  the  test  were  not 
administered  simultaneously  to  the  participants;  however,  each  participant  did  observe  all 
twenty-five  graphs.  Therefore,  subjects  were  classified  the  same  way  for  each  test 

Internal  consistency  measures  the  degree  to  which  instrument  items  are  homogeneous 
and  reflect  the  same  underlying  construct  (1 1:188).  Each  of  the  participants  was  randomly 
assigned  to  identical  386  microcomputers  with  identical  Ouattro  Pro  software  packages. 
Although,  the  order  of  the  graphics  was  randomly  assigned  for  each  participant,  each 
participant  observed  the  exact  same  twenty-five  graphs.  Because  the  response  times  and 
accuracy  measurements  were  recorded  by  the  con^uter,  each  of  the  participants  were 
measured  exactly  the  same.  Additionally,  the  same  two  monitors  were  present  for  all 
computer  laboratory  experiments.  To  eliminate  the  source  of  bias  between  different 
individuals,  a  within-subject  factorial  design  with  repeated  measures  was  also  used  (this 
design  was  explained  previously). 

Practicality.  The  scientific  requirements  of  an  experiment  direct  the  measurement 
process  to  be  reliable  and  valid;  however,  the  operational  requirements  demand  the  test  to 
be  practical  (11:1 89).  Thorndike  and  Hagen  define  practicality  in  terms  of  economy, 
convenience,  and  interpretability,  with  respect  to  the  development  of  educational  and 
psychological  tests  (24:199). 

(1)  Economy  -  tradeoffs  are  typically  required  between  the  ideal  research 
experiment  and  an  experiment  that  is  affordable.  Areas  that  need  to  be 
considered  for  economy  are  the  instrument  length,  and  the  choice  of  the  data 
collection  method. 
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(2)  Convenience  -  a  measuring  device  passes  the  convenience  test  if  it  is  easy  to 
administer.  Areas  that  need  to  be  considered  are  the  instructions  associated 
with  the  experiment,  and  the  layout  of  the  measuring  instrument. 

(3)  Interpietability  -  documented  experimental  procedure  information  is  necessary 
so  other  researchers  will  be  able  to  adequately  assess  your  results. 

Economy  was  considered  in  the  experiment  by  using  the  within-subject  factorial 
design  with  repeated  measures.  Of  course  this  was  not  the  primary  reason  for  the  choice 
of  the  design;  however,  this  design  does  reduce  the  number  of  participants  required  for  the 
experiment.  Also,  the  AFIT  computer  laboratories,  with  the  required  386  microcomputer 
and  the  Quattro  Pro  software  package  were  both  available  and  easily  accessible.  By  using 
a  computer  to  automatically  record  the  results  of  the  experiment,  this  eliminated  the  costs 
associated  with  written  and  telephone  surveys. 

This  experiment  was  convenient  and  extremely  easy  to  administer.  The  task 
complexity  of  the  experiment  was  kept  simple.  Precise  verbal  and  written  instmctions 
were  given  to  all  participants.  To  relieve  any  anxiety  the  participants  may  have  had 
working  on  a  computer,  the  experiment  was  automated  to  the  full  extent  possible.  The 
subjects  entered  their  response  by  pressing  the  corresponding  number  key  on  the  keyboard 
(no  mouse  was  used).  Because  the  results  were  automatically  recorded  into  a  spreadsheet, 
the  accuracy  and  response  time  data  were  easy  to  manipulate. 

The  experiment  is  easy  to  interpret  and  the  documented  Quattro  Pro  program  as  well 
as  the  actual  experiment  is  included  in  Appendices  B  and  A,  respectively.  This  will  allow 
additional  research  to  be  conducted  that  is  above  and  beyond  the  objectives  of  this  thesis. 
To  replicate  this  experiment,  researchers  would  need  to  use  the  same  measurement 
questions,  same  presentation  format,  same  underlying  data  and  so  on. 
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Hie  taxonomy  developed  by  Tan  and  Benbasat  described  in  the  literature  review  for 
characterizing  graphs  and  tasks  was  used  in  constructing  the  experiment.  The  taxonomy 


for  graphs  will  be  examined  to  see  if  it  is  an  accurate  method  for  identifying  which 
graphical  format  is  appropriate  for  a  given  task  (investigative  question  eight).  The 
taxonomy  for  task  will  be  used  to  examine  whether  or  not  there  are  any  elementary  data 
collection  tasks  that  three-dimensional  graphs  facilitate  more  accurate  solutions  than  two- 
dimensional  graphs  and  tables  (investigative  question  six). 

The  first  step  in  constmcting  the  experiment  was  to  identify  the  graphs  and  questions 
R>  be  used.  The  experiment  consisted  of  time-series  graphs  that  depicted  financial 
Information  for  four  regions  (North,  South,  East,  and  West)  over  seven  periods.  This 
information  was  presented  in  five  different  presentation  nnodes:  table,  two-dimensional 
bar,  two-dimensional  line,  three-dimensional  bar,  and  three-dimensional  line.  The 
experimental  package  is  provided  in  Appendix  A.  Each  graph  was  developed  in  strict 
accordance  with  the  criteria  for  high  integrity  graphics.  A  common  software  package 
fOuattro  Pro  for  Windows)  was  used  to  generate  the  graphs.  The  Ouattro  Pro  default 
graphical  format  was  maintained  except  when  it  contradicted  the  criteria  for  high  integrity 
graphics.  Twenty-five  graphs  which  consisted  of  twenty  legitimate  graphs  and  five 
masking  graphs  were  developed  for  the  experiment 

The  second  step  in  constmcting  the  experiment  was  to  identify  the  task  questions  to 
be  used.  Tan  and  Benbasat  suggest  that: 

There  are  four  basic  types  of  information  anchoring  conditions  that 
characterize  data  extraction  task  for  two-dimensional  graphics  with 
one  or  more  instances  of  the  same  entity:  (1)  high  x- value,  high  y- 
value  anchoring;  (2)  high  x-value,  low  y-value  anchoring;  (3)  low  x- 
value,  high  y-value  anchoring;  (4)  low  x-value,  low  y-value 
anchoring.  (22:172) 


Each  of  these  conditions  will  be  represented  by  the  task  questions  used  in  the 
experiment  The  questions  will  be  used  to  measure  how  well  the  various  noodes  of 
graphical  presentation  facilitate  accurate  solutions  to  elementary  data  collection  tasks 
(investigative  question  three). 

The  last  step  in  constructing  the  experin»nt  was  to  determine  the  seventeen 
measurement  questions  for  the  follow-up  survey.  The  purpose  of  the  follow-up  survey  is 
to  obtain  background  information  on  the  participants  and  to  examine  any  pertinent 
opinions  the  participants  may  have. 

Experimental  Item 

A  cc^y  of  the  experimental  item  (graphs/  charts)  is  located  in  Appendix  A.  Appendix 
B  contains  the  end-of-exercise  questionnaire.  The  associated  macros  and  code  for  the 
design  of  the  experiment  are  located  in  Appendix  C. 

Experimental  Procedures 

Sixty-two  AFIT  Professional  Continuing  Education  (PCE)  students  volunteered  to 
participate  in  this  study.  To  maintain  a  balanced  design,  thirty-one  students  were 
randomly  assigned  to  each  of  the  data-set  combinations. 

The  experiment  was  administered  with  a  microcomputer.  The  software  package 
Ouattro  Pro  for  Windows  was  used  to  generate,  automate  and  present  the  twenty-five 
graphical  displays.  Every  effort  was  made  to  ensure  the  displays  met  the  criteria  establish 
by  Tufte  [25].  Subjects  who  volunteered  for  the  experiment  participated  in  groups  of  ten 
to  fifteen  students  in  a  computer  laboratory.  When  participants  arrived  at  the  computer 
laboratory,  they  were  asked  to  sit  down  at  a  computer  terminal  and  wait  for  instructions. 
The  experiment  was  already  loaded  on  each  computer  terminal.  When  everyone  arrived, 
the  subjects  were  given  the  following  instructions: 
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You  will  be  reviewing  twenty-five  graphical  displays  of  financial  data,  and  each 
display  contains  a  multiple  choice  question.  Your  task  is  to  answer  each  question 
X  as  best  you  can  using  the  information  provided  in  the  graph.  Because  all  of  the 

questions  have  four  possible  responses  (1, 2, 3,  or  4),  enter  your  response  by 
pressing  the  corresponding  number  key  on  the  keyboard  .  Should  you  type  a 
number  other  than  one  through  four  you  will  be  given  another  chance  to  respond 
^  appropriately.  After  you  have  entered  an  appropriate  response,  the  computer  will 

display  the  next  graph  and  question.  When  you  have  completed  all  twenty-five 
graphs  you  will  be  asked  a  series  of  seventeen  demographic  questions.  Once  you 
have  completed  the  experiment  you  are  free  to  leave.  If  there  are  no  questions, 
please  proceed  at  your  own  pace. 

Although  the  students  observed  twenty-five  graphs,  measurements  were  only  taken 
from  twenty.  The  additional  five  graphs  were  used  to  help  disguise  the  use  of  the  same 
two  data-sets  in  a  given  data-set  combination. 


End-of  Exercise  Questionnaire 

Following  the  twenty-five  graphs  an  end-of  exercise  questionnaire  containing 
seventeen  questions  and  statements  were  asked.  The  participants  were  told  that  the 
questions  and  statements  concerned:  (1)  the  experiment  they  had  just  completed,  (2)  their 
level  of  experience  with  graphs,  and  (3)  their  background  information  for  demographic 
purposes. 

The  reason  for  the  use  of  a  questionnaire  is  based  on  previous  research  findings  that 
some  percepmal  and  demographic  characteristics  are  significant  in  graphical  presentation 
preferences  and  interpretation  (4:54;  3:68).  The  questionnaire  allowed  additional  research 
to  be  performed  to  determine  if  the  participants  characteristics  affected  the  decision¬ 
making  process. 

The  first  five  questions  related  directly  to  the  experiment  the  participants  had  just 
completed.  These  questions  were  designed  to  allow  a  greater  understanding  of  problems 
or  difficulties  participants  may  have  experienced  during  the  test.  The  experiment  was 
designed  with  simple  task  complexity,  and  these  questions  aided  our  understanding  of  the 
effort  involved  in  extracting  and  assessing  data  in  the  experiment.  Three  of  the  questions 
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(1,4,  and  5)  used  a  seven-point  Likert  scale  anchored  with  well  defined  incremental  levels 
ranging  from  strongly  disagree  to  strongly  agree.  These  questions  were  used  to  determine 
if  the  information  and  questions  were  easy  to  understand  and  if  the  charts  contained  too 
much  information.  "A  person's  ability  to  hold  only  seven  items  in  immediate  memory  for 
compaii.'ion  purposes  has  been  labeled  span  of  absolute  judgment"  (6:28).  This  small  span 
of  absolute  judgment  creates  a  need  to  group  data.  Therefore,  it  is  important  that  report 
formats  use  groupings  that  assist  the  memory  input  process  and  do  not  overload  the 
decision  maker  (6:28).  Questions  2  and  3  listed  the  five  modes  of  presentation;  tables,  2D 
bar  charts,  2D  line  charts,  3D  bar  charts,  3d  line  charts.  The  responses  to  these  questions 
were  used  to  determine  which  of  the  five  modes  of  presentation  used  in  the  experiment, 
were  believed  to  be  the  most  useful  for  identifying  and  comparing  regional  information. 

(^esticMis  6  and  7  were  used  to  identify  the  presentation  format  the  participants 
preferred  for  the  presentation  of  information,  and  to  identify  the  level  of  interest  in  the 
experiment  itself.  (Question  6  included  the  five  modes  of  presentation  as  well  as  an  "other" 
category  to  select  from.  (Question  7  used  a  seven-point  Likert  scale  anchored  with  well 
defined  incremental  levels  ranging  from  very  low  to  very  high. 

Questions  9  through  1 1  were  designed  to  assess  the  level  of  experience  with  graphs, 
and  to  assess  how  often  the  participants  constructed  and  used  graphs  for  and  in  decision¬ 
making,  respectively.  People  can  better  interpret  data  in  graphics  they  are  familiar  with. 
This  familiarity  is  important  because  it  could  have  an  effect  on  the  accuracy  and  response 
time  measurements  obtained  in  the  experiment  The  selected  responses  (8  levels)  ranged 
from  daily  use  and  construction  of  graphs  to  never  using  or  constructing  graphs.  Question 
10  assessed  the  level  of  graphics  training,  in  either  construction  or  interpretation,  the 
participants  have  previously  received.  Although  there  were  7  levels  to  select  from,  there 
were  three  basic  categories  for  training;  formal,  informal  and  no  training.  The  participants 
who  have  received  training  may  have  an  advantage  in  the  interpretation  of  the  graphics. 
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Questions  8  and  12  through  17  requested  demographic  data.  Because  we  used  a 
colcnized  experiment  (the  colors  were  kept  constant  for  every  graph  and  participant  and 
was  not  considered  a  factor),  it  was  necessary  to  determine  if  any  of  the  subjects  were 
color  blind  ((Question  8),  and  to  see  if  this  limitation  affected  the  accuracy  and  response 
time  measurements.  The  sex  of  the  participant  was  of  interest  (Question  12),  because  in 
the  past  gender  was  found  to  be  a  significant  factor  in  graphical  interpretation.  The  rank 
and  education  background  of  the  subjects  (Questions  13  and  14)  were  necessary  to 
determine  the  level  of  managerial  experience.  Typically,  the  more  educated  and  higher 
ranked  the  subjects  arc,  the  greater  their  decision-making  experience.  Also,  the  greater 
their  decision-making  experience,  the  greater  their  breadth  in  analyzing  and  interpreting 
the  various  modes  of  presentation.  Questions  15  through  17  were  used  to  determine  the 
different  areas  and  associated  years  of  professional  experience.  This  is  necessary  to  ensure 
the  participants  arc  representative  of  a  generalizable  population  and  in  decision-making 
positions. 

The  use  of  the  computer  significantly  enhanced  the  administration  of  the  experiment. 
First,  the  computer  randomized  the  sequence  of  graphical  displays  presented  to  each 
subject.  Another  benefit  is  that  the  computer  unobtrusively  measured  the  time  of  each 
subject's  response.  Finally,  the  software  was  coded  to  record  each  subject’s  response  and 
response  time.  When  the  experiment  was  completed  the  results  were  printed  to  a  text  file. 
This  data  transfer  allowed  the  experimental  data  to  be  easily  imported  into  the  statistical 
software  package  that  was  used  to  analyze  experimental  results. 

Conclusion 

An  experiment  was  written  to  test  when  it  is  more  appropriate  to  present  information 
in  a  three-dinKnsional  graph  than  in  a  two-dimensional  graph  or  table.  The  experiment 
was  formulated  using  a  5  x  4  x  2  full-factorial,  within-subject  design.  The  experiment 
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consisted  of  graphs  in  five  different  presentation  modes:  tables,  two-dimensional  line, 
two-dimensional  bar,  three-dimensional  line,  and  three-dimensional  bar.  By  comparing 
how  well  Air  Force  decision  makers  perform  elementary  data  collection  tasks  for  each 
mode  of  presentation,  the  experiment  tested  whether  three-dimensional  graphs  are  more 
accurate  and  efficient  than  two-dimensional  graphs  and  tables.  A  t-test  on  the  differences 
in  two  means  will  be  the  statistic  used  in  the  experimental  analysis. 

Chapter  IV,  Analysis  and  Findings,  will  contain  the  results  of  the  experiment,  and  will 
address  investigative  questions  tiuree,  four  and  five.  Chapter  V,  Conclusion,  will 
summarize  the  results  of  the  study  and  will  discuss  investigative  questions  six,  seven,  and 
eight 
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rV.  Analysis  and  Findings 


^  Introduction 

This  study  used  a  2  x  5  x  4  [Data-set  combination  (A)  x  Mode  of  Presentation  (B)  x 
Task  Anchoring  Level  (C)]  factorial  experiment  in  which  there  are  repeated  measure  on 
the  last  two  factors.  There  are  31  subjects  in  each  data-set  combination  group.  Each 
subject  is  observed  under  all  be  combinations  of  factors  B  (mode)  and  C  (usk),  but  only 
under  a  single  level  of  factor  A  (data-set  combination).  Thus,  there  are  two  groups  of  31 
subjects  each  (62  subjects  in  all)  and  there  are  be  (20)  observations  of  each  subject.  These 
two  groups  were  used  to  test  the  six  hypotheses  identified  early  in  Chapter  3.  The  third, 
four  and  fifth  investigative  questions  are  addressed  in  this  chapter. 

This  chapter  presents  the  data  obtained  from  the  research  and  an  analysis  of  the 
experimental  results  and  findings.  The  chapter  is  divided  into  three  main  sections.  The 
first  section  discusses  seven  tests  that  were  conducted  to  test  for  the  main  effects 
associated  with  factors  A,  B,  and  C,  and  their  interactive  effects.  Section  one  was 
partitioned  into  two  categories:  Accuracy  and  Time  Performance.  These  two  sub-sections 
will  answer  investigative  questions  three  and  four,  respectively.  Section  two,  which 
addresses  investigative  question  five,  describes  the  demographic  analysis,  and  discusses 
those  demographic  characteristics  that  have  an  effect  on  the  subject’s  response  time. 
Finally,  the  last  section  summarizes  the  chapter. 

Experimental  Analysis  and  Findings 

Appendices  D  -  G  contain  the  overall  results  of  the  experimental  data.  Appendix  D 
'  contains  the  raw  data  (for  62  subjects)  which  includes  the  accuracy  and  time  response  data 

for  each  of  the  20  graphs/charts,  as  well  as  the  seventeen  end-of-exercise  questionnaire 
<  responses.  Appendix  E  consists  of  the  natural  logarithm  transformation  tables  of  the 

response  times  that  were  used  for  statistical  analyses.  Appendix  F  includes  the  power  test 
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calculations  and  the  variance-covariance  matrix  information  required  to  test  for  the 
homogeneity  and  equality  assumptions  to  be  discussed  later.  Appendix  G  contains  the 
repeated  measures  calculations  for  the  various  ANOVA  tables  included  in  this  chapter. 

There  were  seven  main  tests  conducted  in  the  analysis  of  the  experiment.  Tests  1  and 
2  were  conducted  to  test  for  the  main  effects  associated  with  the  factors,  mode  of 
presentation  (B)  and  task  anchoring  (C),  respectively.  Tests  1  and  2  tested  for  treatment 
mean  differences,  for  both  factors,  as  they  relate  to  both  subject  response  time  and 
response  accuracy.  Test  3  was  conducted  to  test  for  the  main  effect  of  the  factor  data-set 
combination  (A).  Tests  1  -  3  are  followed  by  Tests  4-7,  which  test  for  factor  interaction 
among  factors  A,  B,  and  C. 

The  analysis  for  these  seven  tests  are  described  in  the  next  two  sections.  Accuracy 
and  Time  Perfonnance.  The  Accuracy  section  discusses  the  Chi-square  analysis  for 
accuracy  based  on  the  frequency  of  correct  responses  for  the  treatment  combinations  of 
task  anchoring  and  mode  of  presentation.  The  Time  Performance  section  explains  the 
multifactor  ANOVA  with  repeated  measures  analysis  of  the  response  time,  and  the  Tukey 
method  of  multiple  comparisons. 

Tests  1-7  and  their  associated  hypotheses  are  described  as  follows; 

Test  1:  Test  for  main  effects  associated  with  the  factor,  mode  of  presentation.  The 
experimental  hypotheses  for  Test  1  were: 

(la)  Hq:  No  difference  exists  between  the  mode  of  presentation  treatment  means  as 

they  relate  to  subject  response  time. 

At  least  two  mode  of  presentation  treatment  means  differ. 

(lb)  Hq;  No  difference  exists  between  the  mode  of  presentation  treatment  means  as 

they  relate  to  response  accuracy. 

Hg:  At  least  two  mode  of  presentation  treatment  means  differ. 
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Test  2:  Test  for  main  effects  associated  with  the  factor,  task  anchoring.  The 
^  experimental  hypotheses  for  Test  2  were: 

(2a)  Hq:  No  difference  exists  between  the  task  anchoring  treatment  means  as  they 
relate  to  subject  response  time. 

A. 

At  least  two  task  anchoring  treatment  means  differ. 

(2b)  Hq:  No  difference  exists  between  the  task  anchoring  treatment  means  as  they 
relate  to  response  accuracy. 

At  least  two  task  anchoring  treatment  means  differ. 

Test  3:  Test  for  main  effects  associated  with  the  factor,  data-set  combination.  The 
experimental  hypothesis  for  Test  3  was: 

(3)  Hq:  No  difference  exists  between  the  data-set  combination  treatment  means  as 
they  relate  to  subject  response  time. 

At  least  two  data-set  combination  treatment  means  differ. 

Issi  4:  Test  for  mode  of  presentation  and  task  anchoring  factor  interaction.  The 
experimental  hypothesis  for  Test  4  was: 

(4)  fig:  The  factors  mode  of  presentation  and  task  anchoring  do  not  interact  to 
affect  response  time  means. 

Hj:  At  least  two  treatment  means  differ. 

Test  5i  Test  for  mode  of  presentation  and  data-set  combination  factor  interaction.  The 
experimental  hypothesis  for  Test  5  was: 

(5)  Hq:  The  factors  mode  of  presentation  and  data-set  combination  do  not 
interact  to  affect  response  time  means. 

At  least  two  treatment  means  differ. 
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Test  6:  Test  for  task  anchoring  and  data-set  combination  factor  interaction.  The 
experimental  hypothesis  for  Test  6  was: 

(6)  Hq:  The  factors  task  anchoring  and  data-set  combination  do  not  interact  to 
affect  response  time  means. 

Hg:  At  least  two  treatment  means  differ. 

Test  7:  Test  for  mode  of  presentation,  task  anchoring,  and  data-set  combination  factor 
interaction.  The  experimental  hypothesis  for  Test  7  was: 

(7)  Hq:  The  factors  mode  of  presentation,  task  anchoring,  and  data-set 
combination  do  not  interact  to  affect  response  time  means. 

H^:  At  least  two  treatment  means  differ. 

Accuracy  Analysis.  Chi-square  analysis  for  accuracy  based  on  the  frequency  of  correct 
responses  for  the  treatment  combinations  of  cj  -  C4  (task  anchoring)  and  bj  -  b5  (mode  of 
presentation)  was  conducted  combining  the  two  data-set  combinations.  The  results  for 
the  Chi-square  analysis  are  displayed  in  Table  14.  These  results  show  that  the  overall  Chi- 
square  statistic  is  not  statistically  significant  at  the  .05  level.  Therefore,  the  null  hypothesis 
for  Test  1  (lb)  and  Test  2  (2b)  are  not  rejected.  These  results  indicate  that  the  majority  of 
the  subjects  achieved  a  high  level  of  accuracy  performance  across  different  modes  of 
presentation  and  task  anchoring  levels  (b  and  c).  However,  the  three-dimensional  line 
graph  had  particularly  low  accuracy  scores  for  High-High  (HH)  and  Low-Low  (LL)  task 
anchoring  (bC5i  and  1x54).  Figure  4  shows  the  percentage  of  correct  responses  for  these 
two  accuracy  scores  is  below  60  percent. 
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Table  14.  Chi-square  Analyses  for  Accuracy  Response. 


Mode  of  niHrttfion  (IQ  X  Tall  Andurbig  (Q 
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Figure  4.  Percentage  of  Correct  Responses. 
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die  major  performance  variance  among  subjects  were  attributed  to  time  differences 
required  for  extracting  the  relative  responses  from  the  graphical  presentations. 


Time  Performance.  As  stated  in  Chapter  4,  the  validity  of  the.  multifactor  ANOVA 
with  repeated  measures  analysis  of  the  response  time  is  based  on  several  assumptions. 
The  first  assumption  is  that  the  observations  represent  random  samples  from  the 
population.  This  assumption  was  met  by  randomly  assigning  the  subjects  to  the  two  test 
groups  and  randomizing  the  order  in  which  each  subject  received  the  treatments.  The 
second  assumption  is  that  the  observations  are  drawn  from  a  normally  disuibuted 
population.  The  histogram  and  normality  plot  for  the  response  time  illustrates  that  the 
data  does  not  meet  the  normality  assumption  (Figures  7  and  8).  A  Wilk-Shapiro  score 
above  0.9  and  a  relatively  straight  45  degree  line  for  the  Rankit  Plot  are  indications  of 
normality. 
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Range 


Figure?.  Response  Time  Histogram. 


Figure  8.  Wilk-Shapiro  Normality  Plot  for  Response  Time. 


To  satisfy  the  normality  assumption,  the  response  times  were  transformed  using  the 
natural  logarithm  (LN).  The  histogram  and  normality  plot  for  the  LN  of  the  response  time 
illustrate  that  the  data  can  be  assumed  to  be  approximately  normal  (Figures  9  and  10). 
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Rgiue  9.  Natural  Logarithm  of  Response  Time  Histogram. 


Figure  10.  Wilk-Shapiro  Normality  Plot  for  the  Natural  Logarithm  of  Response  Time. 
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Additional  assumptions  are  "about  the  form  of  the  variance-covariance  matrix 
associated  with  the  joint  multivariate  ncvmal  distribution  of  the  random  variables  in  the 
model"  (29:517).  Specifically,  the  variance-covariance  matrices  of  factor  A  must  be 
homogeneous,  and  the  covariance  terms  of  the  common  variance-covariance  matrix  must 
be  equal.  These  two  assumptions  were  tested  via  the  procedures  described  in  Winer 
(29:515-517).  The  variance-covariance  matrix  is  located  in  Appendix  F. 

Winer  states  that  the  statistic  for  testing  the  homogeneity  of  the  variance-covariance 
matrix  is: 

Xf  =  (l-C,)M,  (14) 


where: 


(15) 


C.= 


2^^ -H  3^-1 
6(^-H)(p-l) 


(16) 


This  statistic  has  a  sampling  distribution  which  is  approximated  by  a  Chi-squared 
distribution  having  fj  degrees  of  freedom: 


/i  = 


<?(<?+!)(/> -1) 
2 


(17) 


Appendix  F  contains  the  calculations  associated  with  equations  (14)  -  (17)  for  this 
experiment.  The  test  statistic,  has  a  value  of  271.18  with  210  degrees  of  freedom. 
The  p-value  for  this  test  is  .003,  thus,  homogeneity  of  the  variance-covariance  matrix  is 
rejected  at  the  .05  level  of  significance. 

The  assumption  of  circularity  can  be  tested  in  a  similar  manner  using  the  following 
statistic: 

X^=(1-C2)M2  (18) 


A 
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where: 


This  statistic  has  a  sampling  distribution  which  is  approximated  by  a  Chi-squaied 
distribution  having  f2  degrees  of  freedom: 


(21) 


Appendix  F  contains  the  calculations  associated  with  equations  (18)  -  (21)  for  this 
experiment.  The  test  statistic,  Xa  >  ^  value  of  250.61  with  208  degrees  of  freedom. 

The  p-value  for  this  test  is  .023,  thus,  the  assumption  of  circularity  for  the  common 
variance-covariance  matrix  is  rejected  at  the  .05  level  of  significance. 

The  results  of  these  test  indicate  that  the  variance-covariance  matrices  do  not  meet 
the  homogeneity  and  circularity  criteria.  Therefore,  the  conservative  F  tests  from  Table  8 
(Chapter  3)  are  used  to  determine  the  significance  of  factor  effects. 

Table  15  shows  the  results  of  the  multifactor  ANOVA  with  repeated  measures  on  the 
response  time.  Appendix  G  contains  the  calculations  that  support  Table  15.  These 
calculations  were  acccanplished  in  accordance  with  the  computational  procedures 
described  in  the  statistical  analysis  section  of  Chapter  3,  significant  F  ratios  are  emphasized 
with  asterisks. 

Table  15  (ANOVA)  shows  that  the  main  effects  of  factors  B  and  C  are  significant; 
therefore,  the  hypotheses  la  and  2a  are  rejected.  The  AB  and  BC  interaction  effects  are 
also  shown  to  be  sipificant  resulting  in  the  rejection  of  hypotheses  5  and  4,  respectively. 
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Hypotheses  3, 6,  and  7  are  not  rejected  because  the  main  effect  of  factor  A  and  the 
interaction  effects  of  AC  and  ABC  are  insignificant 


Table  15.  Summary  of  Analysis  of  Variance. 


Source  of  Variation 

-SS- 

_dL 

MS 

Ecdt 

Between  Subiects 

56.2 

A  [Data] 

0.3 

1 

0.3 

4.0 

0.353 

Subject  within  groups 
[error  (a)] 

55.9 

60 

0.9 

Within  subiects 

ms. 

liTS 

B  [Mode] 

2.6 

4 

0.6 

4.0 

5.033* 

AB  [Data*Mode] 

3.4 

4 

0.9 

4.0 

6.683* 

B  X  subject  within  groups 
[error  (b)] 

31.0 

240 

0.1 

C  [Task] 

110.6 

3 

36.9 

4.0 

221.9* 

AC  [Data*Task] 

0.4 

3 

0.1 

4.0 

.877 

C  X  subject  within  groups 
[error  (c)] 

29.9 

180 

0.2 

BC  [Mode*Task] 

19.0 

12 

1.6 

4.0 

11.105* 

ABC  [Data*Mode*Task] 

3.4 

12 

0.3 

4.0 

1.985 

BC  X  subjects  within  groups 

102.5 

720 

0.1 

[error  (be)] 


When  the  analysis  of  variance  test  indicates  the  presence  of  factor  effects,  the  next 
step  is  to  analyze  the  nature  of  those  effects.  If  there  are  significant  interactions,  as  there 
are  in  this  case,  the  analysis  of  factor  effects  must  be  based  on  treatment  means  defined  by 
both  factOT  levels.  For  example,  in  a  two-factor  test,  if  the  factors  I  and  J  have  significant 
interaction,  then  the  analysis  of  factor  effects  must  be  based  on  treatment  means  pjj  . 
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Because  Table  15  shows  that  the  three-way  interaction  (ABC)  effect  is  insignificant,  the 
following  analysis  of  treatment  means  focuses  on  only  the  significant  two-way  interaction 
(AB  and  BC)  effects.  Typically,  this  analysis  involves  multiple  pairwise  comparisons  of 
treatment  means  (15:730,739).  This  analysis  uses  the  Tukey  method  as  described  in 
Chapter  3. 

In  this  analysis  the  Tukey  method  of  multiple  comparisons  is  used  to  consider  the  set 
of  all  pairwise  comparisons  of  factor  level  means  when  one  of  the  interacting  factor's  level 
is  fixed.  Recall  from  Chapter  3  that  the  Tukey  method  for  contrast  of  treatment  means  has 
the  following  form  (Equation  (6)): 

L±Ts{l} 

When  a  confidence  interval  for  the  contrast  of  means  computed  through  Equation  (6) 
includes  zero,  then  the  means  are  not  significandy  different.  All  of  the  comparisons  use  a 
family  confidence  coefficient  of  .95.  "A  family  of  pairwise  comparisons  is  considered  to 
be  correct  if  every  pairwise  comparison  in  the  family  is  correct"  (15:582).  Thus,  when  the 
family  confidence  coefficient  is  .95  all  pairwise  comparisons  in  the  family  will  be  correct  in 
95  percent  of  the  families. 

The  first  comparison  of  means  (hypothesis  4)  considers  the  effect  of  the  mode  of 
presentation  when  the  task  anchoring  level  is  held  constant  (BC  interaction).  In  analyzing 
these  comparisons  it  is  helpful  to  have  both  a  visual  and  tabular  representation  of  this  data. 
Figure  1 1  illustrates  the  noode  of  presentation  means  with  their  confidence  intervals  while 
Table  16  contains  all  of  the  Tukey  pairwise  comparison  for  the  HH  (cj)  task  anchoring 
level. 

The  left  column  of  the  Tukey  contrast  of  means  table  (Tables  16  -  23, 25)  identifies 
the  mode  of  presentation  means  being  compared.  The  L(hat)  column  displays  the 
difference  in  the  means  being  compared.  The  Ts{L{hat))  value  is  the  distance  from  the 
mean  to  the  upper  (Column  4)  and  lower  limits  (Column  5)  of  the  confidence  interval. 
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Finally,  an  "X"  is  placed  in  the  last  column  to  show  that  the  means  being  compared  are 
significantly  different 


# 


Figure  11.  Mode  of  Presentation  Mean  and  Confidence  Intervals 
for  Task  Anchoring  Level  (c^). 


Table  16.  Tukey  Contrast  of  Means  for  Task  Anchoring  Level  (cj). 


TslKhot)} 

lysiisii] 

Lower  Limit 

2D-Line  vs  Table 

-0.02200 

0.17394 

0.15194 

-0  19595 

— 

2D-Line  vs  2D-Bar 

-0.03537 

0.17394 

0.13857 

-0.20932 

2D-Line  vs  3D-Bar 

-0.11544 

0.17394 

0.05850 

-0.28939 

2D-Line  vs  3D-Line 

-0.45985 

0.17394 

-0.28591 

-0.63379 

X 

Table  vs  2D-Bar 

-0.01337 

0.17394 

0.16057 

-0.18731 

Table  vs  3D-Bar 

-0.09344 

0.08050 

-0.26738 

Table  vs  3D-Une 

-0.43785 

0.17394 

-0.26390 

-0.61179 

X 

2D-Bar  vs  3D-Bar 

-0.08007 

0.17394 

0.09387 

-0.25401 

2D-Bar  vs  3D-lJne 

-0.42448 

0.17394 

-0.25053 

-0.59842 

X 

3D-Bar  vs  3D-Une 

0.17394 

-0.51835 

X 

From  Figure  1 1,  it  appears  that  only  the  three-dimensional  line  mode  of  presentation 
mean  is  significantly  different  than  the  other  four  mode  of  presentation  means.  The  Tukey 
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comparison  in  Table  16  validates  that  this  perception  is  correct.  The  results  of  this 
analysis  show  that  subjects  interpreting  tables,  two-dimensional  bar,  two-dimensional  line 
and  three-dimensional  bar  graphs  expend  the  same  amount  of  time  performing  elementary 
data  collection  tasks  with  a  HH  Task  Anchoring  Level  (cj).  On  the  other  hand,  it  takes 
subjects  longer  to  interpret  three-dimensional  line  graphs  for  the  same  elementary  data 
collection  tasks  (investigative  question  four). 
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Figure  12.  Mode  of  Presentation  Mean  and  Confidence  Intervals 
for  Task  Anchoring  Level  (cj)- 


Table  17.  Tukey  Contrast  of  Means  for  Task  Anchoring  Level  (C2). 


TsILCkDI 

Lower  Lirrit 

Reject 

SOLine  vs  T  ctie 

-0.09463 

0.17394 

0.07932 

-026857 

3D-Line  vs  2D-Bct 

-0.11184 

0.17394 

0.06210 

-0.28579 

3D-Line  vs  2l>Line 

-0.16150 

0.17394 

0.01244 

-0.33544 

3D-Line  vs  3I>Ba 

-0.30465 

0.17394 

-0.13071 

-0.47859 

X 

Tcbe  vs  2l>Ba 

-0.01722 

0.17394 

0.15672 

-0.19116 

T  cbe  vs  20-Une 

-0.06687 

0.17394 

0.10707 

-0.24082 

T  obe  vs  3[>Ba 

-021002 

0.17394 

-0.03608 

-0.38397 

X 

2I>Ba  vs  2D-Line 

-0.04965 

0.17394 

0.12429 

-022360 

2D-Ba  \«  3I>Ba 

-0.19280 

0.17394 

-0.01886 

-0.36675 

X 

2D-Line  vs  306 a 

-0.14315 

0.17394 

0.03079 

-0.31709 

69 


Rgurc  12  and  Table  17  contains  all  of  the  Tukey  pairwise  comparison  for  the  HL  (C2) 
task  anchoring  level.  From  Figure  12,  it  appears  that  the  three-dimensional  bar  mode  of 
presentation  mean  is  significantly  different  than  the  three-dimensional  line,  table,  and  two- 
dimensional  bar  mode  of  presentation  means.  The  Tukey  comparison  in  Table  17. 
validates  that  this  perception  is  correct  The  results  of  this  analysis  show  that  subjects 
interpreting  three-dimensional  line,  table,  and  two-dimensional  bar  graphs  expend  the 
same  amount  of  time  performing  elementary  data  collection  tasks  with  a  HL  task 
anchoring  level  (C2).  The  results  also  show  that  it  takes  subjects  longer  to  interpret  three- 
dimensional  bar  graphs  for  the  same  elementary  data  collection  tasks.  Finally,  it  is 
interesting  to  note  that  subjects  performance  with  the  two-dimensional  line  graphs  cannot 
be  differentiated  from  any  of  the  other  mode  of  presentations  (investigative  question  four). 


Figure  13.  Mode  of  Presentation  Mean  and  Confidence  Intervals 

for  Task  Anchoring  Level  (C3).  f 

Figure  13  and  Table  18  contains  all  of  the  Tukey  pairwise  comparison  for  the  LH  (03) 
task  anchoring  level.  From  Figure  13,  it  appears  that  none  of  the  mode  of  presentation 
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means  arc  significantly  differcnt  The  Tukey  comparison  in  Table  18  validates  that  this 
perception  is  conect. 


Table  18.  Tukey  Contrast  of  Means  for  Task  Anchoring  Level  (C3). 


Gornocnson 

LM) 

T${L<hci)} 

UDoerLinnit 

Lower  Unnit 

Reiect 

2D-BCT  vs  3D-Ba 

-0.01164 

0.17394 

0.16230 

-0.18558 

2D-Ba  vs  2D-Line 

-0.03026 

0.17394 

0.14368 

-0.20421 

2D-Ba  vs  SD-Line 

-0.14230 

0.17394 

0.03164 

-0.31625 

2D-Ba  vs  T  cbe 

-0.14397 

0.17394 

0.02997 

-0.31791 

3D-Ba  \s  2I>Line 

-0.01862 

0.17394 

0.15532 

-0.19257 

3[>Ba  vs  3D-Line 

-0.13066 

0.17394 

0.04328 

-0.30461 

3D-Ba  vs  T  cde 

-0.13233 

0.17394 

0.04161 

-0.30627 

2D-Line  vs  3D-Line 

-0.11204 

0.17394 

0.06190 

-0.28598 

2I>Line  vs  T  dole 

-0.11371 

0.17394 

0.06024 

-0.28765 

3D-Line  vs  T  cbe 

-0.00167 

0.17394 

0.17228 

-0.17561 

The  results  of  this  analysis  show  that  subjects  expend  the  same  amount  of  time 
performing  elementary  data  collection  tasks  with  a  LH  task  anchoring  level  (C3)  no  matter 
which  mode  of  presentation  they  arc  interpreting  (investigative  question  four). 
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Figure  14.  Mode  of  Presentation  Mean  and  Confidence  Intervals  for  Task  Anchoring  (C4). 


71 


Figure  14  and  Table  19  contains  all  of  the  Tukey  pairwise  comparison  for  the  LL  (C4) 
task  anchoring  level.  From  Figure  14,  it  appears  that  there  are  four  groups  of  means:  (1) 
three-dimensional  line  and  two-dimensional  line;  (2)  two-dimensional  line  and  two- 
dimensional  bar;  (3)  two-dimensional  bar  and  three-dimensional  bar,  and  (4)  three- 
dimensional  bar  and  tables. 


Table  19.  Tukey  Contrast  of  Means  for  Task  Anchoring  Level  (C4). 


OomDcrison 

IM 

TsfL(haei 

UDCser  Limit 

Lower  Limit 

Reiect 

3D-Line  vs  2D-Line 

-0.08636 

0.17394 

0.08758 

-0.26030 

3D-Line  vs  2D-Ba 

-0.24458 

0.17394 

-0.07064 

-0.41853 

X 

3D-Line  vs  3D-Ba 

-0.31431 

0.17394 

-0.14037 

-0.48825 

X 

3D-Line  vs  T  dbe 

-0.45539 

0.17394 

-0.28145 

-0.62933 

X 

2D-Line  vs  2D-Ba 

-0.15822 

0.17394 

0.01572 

-0.33217 

2D-Line  vs  3[>Ba 

-0.22795 

0.17394 

-0.05400 

-0.40189 

X 

2I>Line  vs  T  dole 

■0.36903 

0.17394 

-0.19509 

-0.54297 

X 

2[>Ba  vs  3D-Ba 

-0.06972 

0.17394 

0.10422 

-0.24367 

2D-Ba  vs  T  cde 

-0.21081 

0.17394 

-0.03686 

-0.38475 

X 

3D-Ba  vs  T  cde 

-0.14108 

0.17394 

0.03286 

-0.31502 

Once  again,  the  Tukey  comparison  in  Table  19  validates  that  this  perception  is 
correct.  The  results  of  this  analysis  show  that  there  is  no  distinct  division  between  the 
groups.  However,  subjects  interpreting  the  line  graphs  expend  less  time  performing 
elementary  data  collection  tasks  with  a  LL  task  anchoring  level  (C4),  than  they  do 
interpreting  the  other  modes  of  presentation.  The  results  also  show  that  it  takes  subjects 
the  longest  amount  of  time  to  interpret  tables  for  the  same  elementary  data  collection  tasks 
(investigative  question  four). 

Finally,  it  is  interesting  to  note  through  a  comparison  of  Figures  11  -  14,  that  subjects 
(regardless  of  mode  of  presentation)  performing  elementary  data  collection  tasks  with  LL 
task  anchoring  levels  expend  more  time  than  with  any  other  task  anchoring  level. 

The  second  comparison  of  means  (hypothesis  5)  considers  the  effect  of  the  data-set 


when  the  mode  of  presentation  is  held  constant  (AB  interaction). 


Rgure  15.  Mode  of  Presentation  Mean  and  Confidence  Intervals 
for  Data-Set  Combinations  (A). 


Table  20.  Tukey  Contrast  of  Means  for  Mode  of  Presentation 
and  Data-Set  Combinations. 


Comoarison 

TsfUhot)} 

liDoer  Limit 

Lower  Limit 

Reieci 

0.13388 

0.21228 

1-0.09589) 

0.13388 

0.03799 

-0.22977 

-0.07074 

0. 13388 

-0.07006 

HElsnsaii 

X 

msm 

0.13388 

0.12939 

-0.13837 

Figure  15  and  Table  20  contains  all  of  the  Tukey  pairwise  comparisons  for  the 
analysis  of  the  effects  of  the  mode  of  presentation  and  data-set  combinations.  From 
Figure  15,  it  appears  that  there  is  only  one  mode  of  presentation,  two-dimensional  line 
graphs,  where  the  interaction  with  the  data-set  ctnnbination  produces  a  significant 
difference  in  the  subjects  response  time.  The  Tukey  comparison  in  Table  20  validates  that 
this  perception  is  correct.  The  results  of  this  analysis  suggest  that  data-sets  used  in  this 
experiment  did  not  have  a  significant  effect.  This  was  expected  because  the  data-sets  were 


73 


intentionally  kept  as  similar  as  possible  to  minimize  their  influence.  These  results  do  not 
indicate  that  the  data-set  should  be  neglected  when  choosing  a  mode  of  presentation! 
Certainly,  one  can  easily  imagine  situations  where  the  data-set  may  preclude  the  use  of  a 
particular  mode  of  presentation.  One  example  of  this,  demonstrated  early  in  this  chapter, 
is  where  the  three-dimensional  graph  obscures  data. 

Demographic  Analysis 

Tests  8-11  were  conducted  to  compare  mode  of  presentation  and  task  anchoring 
treatment  means  versus  demographic  data  to  determine  if  a  difference  in  mean  response 
times  could  be  attributed  to  demographic  characteristics.  The  accuracy  of  the  subjects 
response,  considering  subjects  characteristics,  was  not  included  in  this  demographic 
analysis.  Accuracy  was  not  included  because  accuracy  performance  was  high  for  the 
majority  of  subjects  regardless  of  the  mode  of  presentation  or  the  task  anchoring  (refer  to 
Table  14).  The  major  performance  variance  among  subjects  were  attributed  to  time 
differences  required  for  extracting  the  relative  responses  from  the  graphical  presentations. 
Therefore,  subjea  response  time  will  be  the  only  dependent  variable  analyzed  in  this 
section. 

The  results  of  previous  analysis  suggested  that  the  data-sets  used  in  this  experiment 
did  not  have  a  significant  effect.  Therefore,  the  data-set  combination  factor  (A)  was 
excluded  from  this  analysis.  This  resulted  in  eliminating  the  two  data-set  combination 
groups,  and  combining  them  into  one  data  group  of  62  subjects.  The  data-set  combination 
for  factor  A  was  replaced  with  four  separate  demographic  characteristics.  Separate 
analyses  will  determine  the  main  effect  and  interactive  effects  of  each  of  these 
demographic  characteristics. 

The  subject's  training  level,  rank,  gender  and  education  level  were  the  four 
demographic  characteristics  determined  to  be  important  (end-of-exercise  questions  10,  13, 
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12,  and  14,  respectively).  These  characteristics  were  chosen  because  the  researchers 
believed  these  characteristics  (factor  A)  would  have  the  greatest  impact  on  the  subjects 
response  time.  These  characteristics  are  classified  into  the  following  treatment  levels: 

(1)  The  training  level  of  the  subjects  was  divided  into  three  separate  treatment 
levels:  fcnrmal  training  (21  subjects),  informal  training  (17  subjects),  and  no  training  (24 
subjects).  The  formal  and  infoimal  training  classifications  included  those  subjects  who  had 
training  on  either  graph  construction  or  interpretation. 

(2)  The  rank  of  the  subjects  was  divided  into  two  treatment  levels:  low  (48 
subjects)  and  hi^  (14  subjects).  The  low  rank  category  consists  of  individuals  with  rank 
between  GS-3  to  GS-12  or  01  to  0-3.  The  high  rank  category  includes  individuals  with 
rank  between  GS/M-13  to  GS/M-15  or  0-4  and  above. 

(3)  There  were  only  two  treatment  levels  for  gender  48  male  subjects  and  14 
female  subjects. 

(4)  The  subject's  education  level  was  divided  into  two  treatment  levels:  low  (27 
subjects)  and  high  (35  subjects).  High  school  graduates  through  Baccalaureate  Degree 
recipients  were  categorized  in  the  low  level.  Subjects  who  had  received  some  graduate 
courses  to  those  subjects  who  were  Doctoral  Degree  recipients  were  classified  in  the  high 
level. 

There  were  four  tests  conducted  in  the  demographic  analysis.  All  the  tests  tested  for 
treatment  mean  differences,  for  all  four  factors,  as  they  relate  to  subject  response  time. 
Tests  8  was  conducted  to  test  for  the  main  effects  associated  with  the  A  factors;  training 
level  (8a),  rank  (8b),  gender  (8c),  and  education  level  (8d).  Test  9  tests  for  mode  of 
presentation  (B)  and  training  level  (9a),  rank  (9b),  gender  (9c),  and  education  level  (9d) 
(A),  two-way  factor  interaction.  Test  10  tests  for  task  anchoring  level  (C)  and  training 
level  (10a),  rank  (10b),  gender  (10c),  and  education  level  (lOd)  (A),  two-way  factor 
interaction.  Finally,  test  1 1  tests  for  mode  of  presentation  (B),  task  anchoring  (C),  and 
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training  level  (1  la),  rank  (1  lb),  gender  (1  Ic),  and  education  level  (1  Id)  (A),  three-way 

factor  interaction.  Tests  8-11  and  their  associated  hypotheses  are  described  as  follows:  ^ 


l£SL^:  Test  for  main  effects  associated  with  the  factors;  training  level,  rank,  gender  and 
education  level.  The  experimental  hypotheses  for  Test  8  were: 

(8a)  Hq:  No  difference  exists  between  the  training  level  treatment  means  as  they 
relate  to  subject  response  time. 

H^:  At  least  two  training  level  treatment  means  differ. 

(8b)  Hq;  No  difference  exists  between  the  rank  treatment  means  as  they  relate  to 
subject  response  time. 

H^:  The  two  rank  treatment  means  differ. 

(8c)  Hq;  No  difference  exists  between  the  gender  treatment  means  as  they  relate  to 
subject  response  time. 

Ha:  The  two  gender  treatment  means  differ. 

(8d)  Hq:  No  difference  exists  between  the  education  level  treatment  means  as  they 
relate  to  subject  response  time. 

Ha:  At  least  two  education  level  treatment  means  differ. 


Test  9:  Test  for  mode  of  presentation  and  training,  rank,  gender  and  education  level 
factor  interaction.  The  experimental  hypotheses  for  Test  9  were: 

(9a)  Hq:  The  factors  mode  of  presentation  and  training  level  do  not  interact  to 
affect  response  time  means. 

Ha-  At  least  two  treatment  means  differ. 

(9b)  Hq:  The  factors  mode  of  presentation  and  rank  do  not  interact  to  affect 
response  time  means. 

Ha:  At  least  two  treatment  means  differ. 
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(9c)  Hq:  The  factors  mode  of  presentation  and  gender  do  not  interact  to  affect 
response  time  means. 

% 

At  least  two  treatment  means  differ. 

(9d)  Hq;  The  factors  mode  of  presentation  and  education  level  do  not  interact  to 
4  affect  response  time  means. 

At  least  two  treatment  means  differ. 

Test  10;  Test  for  task  anchoring  level  and  training,  rank,  gender  and  educatitm  level 
factor  interaction.  The  experimental  hypotheses  for  Test  10  were: 

(10a)  Hq,*  The  factors  task  anchoring  level  and  training  level  do  not  interact  to  affect 
response  time  means. 

At  least  two  treatment  means  differ. 

(10b)  Hq:  The  factors  task  anchoring  level  and  rank  do  not  interact  to  affect 
response  time  means. 

At  least  two  treatment  means  differ. 

(10c)  Hq:  The  factors  task  anchoring  level  and  gender  do  not  interact  to  affect 
response  time  means. 

H^:  At  least  two  treatment  means  differ. 

(lOd)  Hq:  The  factors  task  anchoring  level  and  education  level  do  not  interact  to 
affect  response  time  means. 

At  least  two  treatment  means  differ. 

Test  11:  Test  for  mode  of  presentation,  task  anchoring,  and  training,  rank,  gender  and 
education  level  factor  interaction.  The  experimental  hypotheses  for  Test  1 1  were: 

(11a)  Hq:  The  factors  mode  of  presentation,  task  anchoring,  and  training  level  do 
not  interact  to  affect  response  time  means. 

Ha:  At  least  two  treatment  means  differ. 
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(lib)  Hq:  The  factors  mode  of  presentation,  task  anchoring,  and  rank  do  not 
interact  to  affect  response  time  means. 

At  least  two  treatment  means  differ. 

(11a)  Hq:  The  factors  mode  of  presentation,  task  anchoring,  and  gender  do  not 
interact  to  affect  response  time  means. 

At  least  two  treatment  means  differ. 

(1  la)  Hq:  The  factors  mode  of  presentation,  task  anchoring,  and  education  level  do 
not  interact  to  affect  response  time  means. 

At  least  two  treatment  means  differ. 

Tables  21, 22, 23,  and  25  show  the  results  of  the  multifactor  ANOVA  with  repeated 
measures  on  the  response  time  for  the  demographic  factors;  training  level,  rank,  gender, 
and  education  level  (Appendix  G  contains  the  calculations  that  support  Tables  21, 22, 23, 
and  25).  All  the  ANOVA  table  calculations  were  accomplished  in  accordance  with  the 
computational  procedures  described  in  the  statistical  analysis  section  of  Chapter  3, 
significant  F  ratios  are  emphasized  with  asterisks.  Because  the  mode  of  presentation  (B) 
and  task  anchoring  level  (C)  factors  have  been  analyzed  in  the  previous  section,  the 
following  discussion  of  the  summary  of  analysis  tables  will  address  only  the  main  and 
interactive  effects  of  the  factors  (A);  training,  rank,  gender,  and  education  level,  with  the 
B  and  C  factors. 

As  expected,  ANOVA  Table  21  shows  that  the  main  effects  of  factors  B  and  C,  and 
the  BC  interaction  effect  are  significant;  however,  the  main  effect  of  factors  A,  training 
level,  is  not  signiricant,  therefore,  the  hypothesis  8a  is  not  rejected.  Also,  hypotheses  9a, 
10a,  and  1  la  arc  not  rejected  because  the  main  effect  of  factor  A  and  the  interaction 
effects  of  AB,  AC,  and  ABC  are  insignificant.  Therefore,  the  results  of  the  analysis  show 
that  the  training  level  of  the  subjects  (formal,  informal,  no  training)  does  not  have  an  effect 
on  the  response  time  (investigative  question  five). 
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Table  21.  Summary  of  Analysis  of  Variance  for  Training. 


Source  of  Variation 

-dL 

MS 

EsnL 

-L. 

Between  Subiects 

56.2 

M 

A  [Training  Level] 

1.4 

2 

0.697 

4.0 

0.750 

Subject  within  groups 
[error  (a)] 

54.8 

59 

0.929 

Within  subiects 

302,9 

1178 

B  [Mode] 

2.6 

4 

0.649 

4.0 

4.547* 

AB  [Training*Mode] 

0.7 

8 

0.089 

4.0 

0.625 

B  X  subject  within  groups 
[error  (b)] 

33.7 

236 

0.143 

C  [Task] 

110.6 

3 

36.881 

4.0 

225.2* 

AC  [Training*Task] 

1.4 

6 

0.227 

4.0 

1.387 

C  X  subject  within  groups 
[error  (c)] 

29.0 

177 

0.164 

BC  [Mode*Task] 

19.0 

12 

1.582 

4.0 

10.915* 

ABC  [Training*Mode*Task] 

3.4 

24 

0.140 

4.0 

0.964 

BC  X  subjects  within  groups 

102.6 

708 

0.145 

[error  (be)] 


Once  again.  Table  22  shows  that  the  main  effects  of  factors  B  and  C,  and  the  BC 
interaction  effect  are  significant;  however,  the  main  effect  of  factors  A,  rank,  is  not 
significant,  therefore,  the  hypothesis  8b  is  not  rejected.  Also,  hypotheses  9b,  10b,  and  1  lb 
are  not  rejected  because  the  main  effect  of  factor  A  and  the  interaction  effects  of  AB,  AC, 
and  ABC  are  insignificant.  Therefore,  the  results  of  the  analysis  also  show  that  the  rank  of 
the  subjects  (low  or  high  rank)  does  not  have  an  effect  on  the  response  time  (investigative 
question  five). 
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Table  22.  Summary  of  Analysis  of  Variance  for  Rank. 


Source  of  Variation 

-SS_ 

_dL 

Fcrit 

Between  Subiects 

56.2 

61 

A  [Rank] 

0.1 

1 

0.091 

4.0 

0.097 

Subject  within  groups 
[error  (a)] 

56.1 

60 

0.936 

Within  subiects 

302.9 

1178 

B  [Mode] 

2.6 

4 

0.649 

4.0 

4.547* 

AB  [Rank*Mode] 

0.1 

4 

0.036 

4.0 

0.252 

B  X  subject  within  groups 
[error  (b)] 

34.3 

240 

0.143 

C  [Task] 

110.6 

3 

36.881 

4.0 

220.0* 

AC  [Rank*Task] 

0.2 

3 

0.056 

4.0 

0.335 

C  X  subject  within  groups 
[error  (c)J 

30.2 

180 

0.168 

BC  [Mode*Task] 

19.0 

12 

1.582 

4.0 

10.865* 

ABC  [Rank*Mode*Task] 

1.1 

12 

0.095 

4.0 

0.650 

BC  X  subjects  within  groups 

104.8 

720 

0.146 

[error  (be)] 


Table  23  also  shows  that  the  main  effects  of  factors  B  and  C,  and  the  BC  interaction 
effect  are  significant  The  analysis  also  shows  that  the  main  effect  of  factor  A,  gender,  and 
the  AB  and  ABC  interactive  effects  are  not  significant;  however,  the  AC  interaction  effect 
is  significant  Therefore,  this  results  in  rejecting  only  hypothesis  10c,  and  not  rejecting 
hypotheses  8c,  9c,  and  1  Ic. 

When  the  analysis  of  variance  test  indicates  the  presence  of  factor  effects,  the  next 
step  is  to  analyze  the  nature  of  those  effects.  If  there  are  significant  interactions,  as  there 
are  in  this  case,  the  analysis  of  factor  effects  must  be  based  on  treatment  means  defined  by 
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b(^  factor  levels.  Because  Table  23  shows  that  the  three-way  interaction  (ABC)  effect  is 
insignificant,  the  following  analysis  of  treatment  means  focuses  on  only  the  significant 

Table  23.  Summary  of  Analysis  of  Variance  for  Gender. 


Source  of  Variation 

-ilL 

MS 

Fcrit 

F 

Between  Subiects 

5^ 

M 

A  [Gender] 

0.3 

1 

0.284 

4.0 

0.304 

Subject  within  groups 
[error  (a)] 

55.9 

60 

0.932 

Within  subiects 

302.9 

1178 

B  [Mode] 

2.6 

4 

0.649 

4.0 

4.676* 

AB  [Gender*Mode] 

1.1 

4 

0.273 

4.0 

1.962 

B  X  subject  within  groups 
[error  (b)] 

33.3 

240 

0.139 

C  [Task] 

110.6 

3 

36.881 

4.0 

235.0* 

AC  [Gender*Task] 

2.1 

3 

0.698 

4.0 

4.446* 

C  X  subject  within  groups 
[error  (c)] 

28.3 

180 

0.157 

BC  [Mode*Task] 

19.0 

12 

1.582 

4.0 

10.860* 

ABC  [Gender*Mode*Task] 

1.1 

12 

0.090 

4.0 

0.619 

BC  X  subjects  within  groups 

104.9 

720 

0.146 

(error  (be)] 


two-way  interaction  (AC)  effect.  Typically,  this  analysis  involves  multiple  pairwise 
comparisons  of  treatment  means  (15:730,739).  This  analysis  uses  the  same  Tukey  method 
as  described  earlier. 


All  of  the  comparisons  use  a  family  confidence  coefficient  of  .95.  The  first 
comparison  of  means  (hypothesis  10c)  considers  the  effect  of  gender  when  the  task 


anchoring  level  is  held  constant  (AC  interaction).  Figure  16  illustrates  the  gender  means 
with  their  confidence  intervals  while  Table  24  contains  all  of  the  Tukey  pairwise 
comparisons  for  the  task  anchoring  levels. 


Figure  16.  Task  Anchoring  Level  Mean  and  Confidence  Intervals  for  Gender  (A). 
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Table  24.  Tukey  Contrast  of  Means  for  Gender  and  Task  Anchoring  Level. 
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Figure  16  and  Table  24  contains  all  of  the  Tukey  pairwise  comparison  for  the  analysis 
of  the  effects  of  gender  and  task  anchoring  level.  From  Figure  16,  it  appears  that  the 
gender  of  the  subjects  has  no  interaction  effect  with  any  of  the  four  task  anchoring  levels. 
The  Tukey  comparison  in  Table  24  verifies  that  this  perception  is  correct.  The  results  of 


82 


this  analysis  suggest  that  regardless  of  gender,  subjects  spend  the  same  amount  of  time 
performing  elementary  data  collection  tasks  (investigative  question  five).  Therefore, 
hypothesis  10c  is  not  rejected. 


Table  25.  Summary  of  Analysis  of  Variance  for  Education  Level. 


Source  of  Variation 

-ilL 

_MS_ 

Fcrit 

JL. 

Between  Subiects 

56.2 

M 

A  [Education  Level] 

3.6 

1 

3.550 

4.0 

4.043* 

Subject  within  groups 
[error  (a)] 

52.7 

60 

0.878 

Within  subiects 

302.9 

1178 

B  [Mode] 

2.6 

4 

0.649 

4.0 

4.700* 

AB  [Education*Mode] 

1.3 

4 

0.315 

4.0 

2.281 

B  X  subject  within  groups 
[error  (b)] 

33.2 

240 

0.138 

C  [Task] 

110.6 

3 

36.881 

4.0 

230.3* 

AC  [Education*Task] 

2.1 

3 

0.508 

4.0 

3.174 

C  X  subject  within  groups 
[error  (c)] 

28.8 

180 

0.160 

BC  [Mode*Task] 

19.0 

12 

1.582 

4.0 

10.992* 

ABC  [Education*Mode*Task] 

1.7 

12 

0.140 

4.0 

0.965 

BC  X  subjects  within  groups 

104.3 

720 

0.145 

[error  (be)] 


Table  25  shows  that  the  main  effects  of  factors  A,  B,  C,  and  the  BC  interaction  effect 
are  significant.  Once  again,  the  main  effects  of  factors  B  and  C  and  the  BC  interactio.i 
effect  are  expected  to  be  significant  It  is  interesting  to  note  that  although  the  main  effect 
of  factor  A  is  significant,  the  analysis  shows  that  the  AB,  AC,  and  ABC  interactive  effects 
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are  not  significant.  However,  remember  that  the  conservative  F  tests  from  Table  8 
(Chapter  3)  were  used  to  determine  the  significance  of  factor  effects.  If  the  conservative  F 
tests  were  not  used,  then  perhaps  the  AB  and  AC  interactive  effects  would  be  significant 
since  the  F  ratio  values  for  these  interactive  effects  are  relatively  high.  Although,  this 
analysis  results  in  not  rejecting  hypotheses  9d,  lOd,  and  1  Id,  and  rejecting  hypothesis  8d, 
the  following  discussion  will  also  include  the  analysis  of  the  AB  (9d)  and  AC  (lOd) 
interactive  effects. 

The  first  comparison  of  means  (hypothesis  lOd)  considers  the  effect  of  education 
level  when  the  task  anchoring  level  is  held  constant  (AC  interaction).  Figure  17  illustrates 
the  gender  means  with  their  confidence  intervals  while  Table  26  contains  all  of  the  Tukey 
pairwise  comparisons  for  the  task  anchoring  levels. 


Figure  17.  Task  Anchoring  Level  Mean  and  Confidence  Intervals  for  Education  Level(A). 
Table  26.  Tukey  Contrast  of  Means  for  Education  Level  and  Task  Anchoring  Level. 
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Figure  17  and  Table  26  contains  all  of  the  Tukey  pairwise  comparisons  for  the 
analysis  of  the  effects  of  the  education  level  and  task  anchoring  level.  From  Figure  17,  it 
appears  that  there  is  only  one  task  anchoring  level,  LH  (C3),  where  the  interaction  with  the 
^  education  level  produces  a  significant  difference  in  the  subjects  response  time.  The  Tukey 

comparison  in  Table  26  verifies  that  this  perception  is  correct.  In  the  ANOVA  table,  the 
results  suggest  that  the  AC  interactive  effect  was  insignificant;  however,  the  comparison 
of  means  analysis  show  that  there  is  an  interactive  effect  with  one  of  the  four  task 
anchoring  levels  (C3);  therefore,  hypothesis  lOd  is  rejected  (investigation  question  five). 

The  second  comparison  of  means  (hypothesis  lOd)  considers  the  effect  of  education 
level  when  the  mode  of  presentation  is  held  constant  (AB  interaction).  Figure  18 
illustrates  the  educational  level  means  with  their  confidence  intervals  while  Table  27 
contains  all  of  the  Tukey  pairwise  comparisons  for  the  mode  of  presentations. 


Figure  18.  Mode  of  Presentation  Mean  and  Confidence  Intervals  for  Education  Level  (A). 
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From  Figure  18,  it  appears  that  there  is  only  one  mode  of  presentation,  two- 
dimensional  line,  where  the  interaction  with  the  education  level  produces  a  significant 
difference  in  the  subjects  response  time.  The  Tukey  comparison  in  Table  27  verifies  that 
this  perception  is  correct.  In  the  ANOVA  table,  the  results  suggest  that  the  AB  interactive 
effect  was  also  insignificant;  however,  the  comparison  of  means  analysis  show  that  there  is 


Table  27.  Tukey  Contrast  of  Means  for  Education  Level  and  Mode  of  Presentation. 
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an  interactive  effect  with  one  of  the  five  modes  of  presentation;  therefore,  hypothesis  9d  is 
also  rejected  (investigative  question  five). 


Summary 

Chi-square  analysis  was  used  to  determine  if  differences  exist  between  the  mode  of 
presentation  and  task  anchoring  level  treatment  means  as  they  relate  to  response  accuracy. 
This  analysis  was  used  to  answer  investigative  question  three.  The  results  of  the  Chi- 
square  analysis  indicate  that  the  majority  of  the  subjects  achieved  a  high  level  of  accuracy 
performance  across  the  different  modes  of  presentation  and  task  anchoring  levels.  In 
general,  accuracy  performance  was  high  for  most  subjects  regardless  of  the  mode  of 
presentation  or  the  task  anchoring,  thus  eliminating  time-accuracy  tradeoffs  as  a  potential 
decision  criterion  for  graphical  format .  Therefore,  the  major  performance  variance 
among  subjects  were  attributed  to  time  differences  required  for  extracting  the  relative 
responses  from  the  graphical  presentations.  Thus,  the  various  modes  of  graphical 
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presentation  do  not  affect  the  accuracy  associated  with  given  elementary  data  extraction 
t  tasks. 

The  general  format  of  the  Multifactor  Analysis  of  Variance  with  Repeated  Measures 
^  technique  was  used  to  identify  differences  between  the  various  experimental  treatment 

means.  This  method  was  used  to  determine  the  main  and  interaction  effects  of  the  mode, 
task,  and  data  factors  on  the  response  time  when  the  subject  is  observed  under  more  than 
one  treatment  condition.  When  the  analysis  of  variance  returned  a  significant  finding,  the 
next  step  in  the  statistical  analysis  was  to  perform  a  comparison  of  means.  The  Tukey 
method  was  used  for  all  pairwise  comparisons  of  factor  level  means.  All  of  the 
comparisons  were  analyzed  with  a  family  confidence  coefficient  of  .95.  The  Multifactor 
Analysis  of  Variance  with  Repeated  Measures  and  the  Tukey  comparison  of  means 
procedures  were  used  to  answer  the  fourth  investigative  question.  The  following 
paragraphs  summarize  the  results  of  the  analysis  and  explain  the  efficiency  of  the  various 
modes  of  presentation  associated  with  given  elementary  data  extraction  tasks. 

(1)  Subjects  interpreting  tables,  two-dimensional  bar,  two-dimensional  line  and 
three-dimensional  bar  graphs  expend  the  same  amount  of  time  performing  elementary  data 
collection  tasks  with  a  HH  Task  Anchoring  Level  (cj). 

(2)  Subjects  interpreting  three-dimensional  line,  table,  and  two-dimensional  bar 
graphs  expend  the  same  amount  of  time  performing  elementary  data  collection  tasks  with 
a  HL  task  anchoring  level  (C2).  Subjects  also  took  longer  to  interpret  three-dimensional 
bar  graphs  for  the  same  elementary  data  collection  tasks.  Finally,  subjects  performance 
with  the  two-dimensional  line  graphs  could  not  be  differentiated  from  any  of  the  other 
modes  of  presentation. 

(3)  Subjects  expend  the  same  amount  of  time  performing  elementary  data 
collection  tasks  with  a  LH  task  anchoring  level  (03)  no  matter  which  mode  of  presentation 
they  are  interpreting. 
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(4)  There  was  no  distinct  division  between  the  groups  performing  elementary  data 

collection  tasks  with  a  LL  task  anchoring  level  (C4).  However,  subjects  interpreting  the  ^ 

line  graphs  expend  less  time  performing  these  elementary  data  collection  tasks,  than  they 
did  interpreting  the  other  modes  of  presentation.  It  also  takes  subjects  the  longest  to 
interpret  tables  for  the  same  elementary  data  collection  tasks. 

(5)  Finally,  subjects  (regardless  of  mode  of  presentation)  performing  elementary 
data  collection  tasks  with  LL  task  anchoring  levels  expend  more  time  than  with  any  other 
task  anchoring  level. 

It  appeared  that  there  was  only  one  mode  of  presentation,  two-dimensional  line 
graphs,  where  the  interaction  with  the  data-set  combination  produced  a  significant 
difference  in  the  subjects  response  time.  The  results  of  the  analysis  indicated  that  data-sets 
used  in  this  experiment  did  not  have  a  significant  effect.  However,  these  results  do  not 
indicate  that  the  data-set  should  be  neglected  when  choosing  a  mode  of  presentation. 

Tests  were  conducted  to  compare  mode  of  presentation  and  task  anchoring  treatment 
means  versus  demographic  data  to  determine  if  a  difference  in  mean  response  times  could 
be  attributed  to  demographic  characteristics.  Four  demographic  characteristics  were 
chosen  for  the  analysis;  training  level,  rank,  gender,  and  education  level.  This  analysis  was 
used  to  answer  investigative  question  five,  and  determine  if  there  are  any  demographic 
characteristics  of  the  participants  which  affect  their  ability  to  efficiently  perform 
elementary  data  collection  tasks.  The  following  paragraphs  summarize  the  results  of  the 
analysis. 

(1)  The  training  level  of  the  subjects  did  not  have  an  effect  on  the  response  time. 

(2)  The  rank  of  the  subjects  does  not  have  an  effect  on  the  response  time. 

(3)  Regardless  of  gender,  subjects  spent  the  same  amount  of  time  performing 
elementary  data  collection  tasks. 
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(4)  It  appeared  that  there  was  only  one  task  anchoring  level,  LH  (03)  and  one 
mode  of  presentation,  two-dimensional  line,  whwe  the  interaction  with  the  education  level 
produced  a  significant  difference  in  the  subjects  response  time. 

Chapter  V,  Conclusion,  will  summarize  the  results  of  the  study,  address  investigative 
questions  six,  seven,  and  eight,  and  discuss  the  limitations  of  the  study  as  well  as  the 
implications  of  the  findings. 


♦ 
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Introduction 


V.  Conclusion 


A  graphical  image  has  the  ability  to  summarize  complex  relationships  among  large 
quantities  of  data  into  an  easily  understood  trend.  This  makes  a  graph  an  effective  tool  for 
influencing  our  perception  of  the  relationships  that  exist  in  the  data  being  portrayed.  It 
also  makes  a  graph  extremely  useful  in  the  decision-making  process.  Using  graphics  is  an 
effective  method  to  communicate  ideas,  and  it  enhances  the  chance  of  success.  Graphics 
are  used  to  make  a  point,  illustrate  a  trend,  or  make  comparisons  so  the  data  are  more 
easily  understood.  The  presenter  must  select  an  appropriate  graphical  format  that  will 
capture  the  audience's  attention  and  enable  the  audience  to  make  an  accurate  decision. 

In  the  past,  researchers  have  focused  a  significant  amount  of  attention  on  the  effects  of 
graphical  format  on  decision-making.  However,  the  question  of  whether  or  not  graphs  are 
better  than  tables  for  data  presentation  still  remains.  Much  of  the  early  research  that 
compared  graphs  to  tables  provided  conflicting  results.  DeSanctis  (9),  Davis  (8),  Tan  and 
Benbasat  (22),  and  Jarvenpaa  and  Dickson  (13),  provide  numerous  examples  of  studies 
that  conflict.  Some  of  the  studies  indicated  graphs  were  superior,  while  others  indicated 
they  were  not  superior.  There  are  still  other  studies  where  the  findings  are  equivocal. 

In  an  attempt  to  reduce  these  conflicting  results,  DeSanctis  (9)  wrote  a  paper  that  is 
instrumental  for  much  of  today’s  research  because  it  identifies  the  major  dependent 
variables  in  graphics  research  and  provides  the  rationale  for  their  use.  Collectively,  these 
variables  are  the  basis  for  measuring  the  effectiveness  of  a  data  presentation  format  in 
experimental  research.  In  our  experiment  we  considered  the  following  dependent 
variables:  interpretation  accuracy,  decision  speed  and  task  performance. 

Tan  and  Benbasat  state  that  “the  majtM-  cause  of  contradictory  results  is  the  various 
and  differing  tasks  used  in  these  experiments  and  the  match  (or  mismatch)  between  the 
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task  (i.e.  the  decision  to  be  made  based  on  the  graph)  and  presentation  method  (i.e.  the 
graph  format)”  (22:168).  Jarvenpaa,  Dickson,  and  DeSanctis  state  that  “future  research 
efforts  will  keep  producing  contradictory  results  unless  researchers  develop  some  type  of 
taxonomy  of  task  and  start  interpreting  the  results  within  the  taxonomy"  (13: 144). 

As  a  foundation  for  graphics  research.  Tan  and  Benbasai  developed  a  task  taxonomy 
and  an  information  presentation  taxonomy  which  were  integrated  to  predict  the  best 
matches  between  task  types  and  presentation  types  (22:168).  This  taxonomy  is  based  on 
operational  definitions  of  x-value  anchoring,  y-value  anchoring,  and  entity  (data-set) 
anchoring.  In  other  words,  anchoring  is  the  technique  decision-makers  use  to  break  down 
and  interpret  graphs. 

To  expound  upon  previous  research  accomplished  by  Davis  (8),  and  Tan  and  Benbasat 
(22),  this  study  incorporated  elements  of  their  research  into  the  experiment.  The  objective 
of  this  study  was  to  determine  whether  or  not,  and  by  how  much,  three-dimensional 
graphs  are  more  efficient  and  accurate  than  two-dimensional  graphs  and  tables,  when 
presenting  alternatives  to  decision  makers.  In  this  experiment,  task  complexity  was 
measured  using  the  method  advocated  by  Davis.  He  proposed  that  the  task  characteristic 
is  an  important  variable  which  needs  to  be  controlled  when  determining  the 
appropriateness  of  the  graphical  format,  and  one  of  the  most  important  task  characteristics 
to  control  is  task  complexity  (8).  This  experiment  also  integrated  the  task  and 
presentation  taxonomies  developed  by  Tan  and  Benbasat,  and  focused  on  elementary  data 
extraction  for  tasks.  Although  this  study  has  incorporated  elements  of  their  research  into 
the  experiment,  another  dimension  has  been  added  -  three  dimensional  graphs.  Previously, 
researchers  have  neglected  to  examine  the  effects  of  three-dimensional  graphs  on  decision 
makers.  Therefore,  we  have  included  three-dimensional  graphs  as  an  additional  type  of 
mode  of  presentation  we  will  consider  in  the  research. 
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This  study  compared  and  contrasted  tables,  two-dimensional  line  and  bar  charts,  and 
three-dimensional  line  and  bar  charts  to  determine  whether  or  not,  and  by  how  much, 
three-dimensional  graphs  are  more  efficient  and  accurate  than  two-dimensional  graphs  and  * 

tables. 

t 

Summary  of  Results 

The  following  propositions  developed  by  Tan  and  Benbasat  (22)  were  used  to  guide 
the  design  of  the  experiment,  interpret  the  findings,  and  answer  investigative  questions  six, 
seven,  and  eight; 

Proposition  1:  The  performance  of  tasks  (accuracy  and  speed)  characterized  by 
high  x-value  and  high  y- value  (HH)  anchoring  is  expected  to  be  bener  facilitated 
by  using  vertical  bar  charts  and  tables  than  by  using  line  graphs. 

Proposition  2:  The  performance  of  tasks  (accuracy  and  speed)  characterized  by 
high  x-value  and  low  y-value  (HL)  anchoring  is  expected  to  be  better  facilitated  by 
using  vertical  bar  charts  than  by  using  tables  and  line  graphs. 

Proposition  3:  The  performance  of  tasks  (accuracy  and  speed)  characterized  by 
low  x-value  and  high  y-value  (LH)  anchoring  is  expected  to  be  better  facilitated  by 
using  line  graphs  than  by  using  tables  and  bar  charts. 

Proposition  4:  The  performance  of  tasks  (accuracy  and  speed)  characterized  by 
both  low  x-value  and  y-value  (LL)  anchoring  is  expected  to  be  better  facilitated  by 
using  line  graphs  than  by  using  bar  charts  and  tables. 

To  address  investigative  question  six,  the  researchers  needs  to  determine  if  there  are  v 

any  elementary  data  collection  tasks  in  which  three-dimensional  graphs  facilitate  more 
accurate  solutions  than  two-dimensional  graphs  and  tables.  The  results  of  the  accuracy 

* 

analysis  indicate  that  the  majority  of  the  subjects  achieved  a  high  level  of  accuracy 
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performance  across  the  different  modes  of  presentation  and  task  anchoring  levels. 

However,  the  three-dimensional  line  graph  had  particularly  low  accuracy  scores  for  HH 
and  LL  task  arc^’oring.  The  reason  for  the  low  scores  are  attributed  to  the  fact  that  the 
three-dimensional  line  graphs  have  a  tendency  to  obscure  data.  In  general,  accuracy 
performance  was  high  for  most  subjects  regardless  of  the  mode  of  presentation  or  the  task 
anchoring.  Therefore,  the  various  modes  of  graphical  presentation  do  not  affect  the 
accuracy  associated  with  given  elementary  data  extraction  tasks.  Thus,  there  are  no 
elementary  data  collection  tasks  where  three-dimensional  graphs  facilitate  more  accurate 
solutions  than  two-dimensional  graphs  and  tables. 

Investigative  question  seven  is  answered  by  determining  if  there  are  any  elementary 
data  collection  tasks  in  which  three-dimensional  graphs  facilitate  more  efficient  solutions 
than  two-dimensional  graphs  and  tables.  The  following  numbered  paragraphs  discuss  the 
analysis  of  the  results,  on  decision  speed  or  time  performance,  which  relate  to  question 
seven.  These  paragraphs  directly  correlate  with  the  Tan  and  Benbasat  numbered 
propositions  stated  earlier. 

(1)  In  the  analysis  of  the  results  on  decision  speed,  the  researchers  discovered  that 
the  HH  anchoring  questions  were  not  interpreted  any  differently  for  tables,  two- 
dimensional  bar,  two-dimensional  line  and  three-dimensional  bar  graphs.  However,  it 
took  subjects  longer  to  interpret  three-dimensional  line  graphs  for  the  HH  elementary  data 
collection  task.  This  finding  suppons  Tan  and  Benbasat's  first  proposition,  except  that 
two-dimensional  line  graphs  were  found  to  be  equivalent  in  time  performance  as  opposed 
to  being  longer. 

(2)  In  contrast  to  Tan  and  Benbasat's  proposition,  it  was  determined  through 
analysis  that  the  two-dimensional  bar  charts,  three-dimensional  line  graphs  and  tables  were 
interpreted  relatively  the  same  while  three-dimensional  bar  chans  were  interpreted  longer 
for  the  HL  anchoring  questions.  Subjects  performance  with  the  two-dimensional  line 
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graphs  could  not  be  differentiated  from  any  of  the  other  mode  of  presentations.  There  was 
no  clear  distinction  the  bar  charts  were  interpreted  faster  for  the  HL  anchoring  questions. 

(3)  Subjects  spent  the  same  amount  of  time  performing  elementary  data  collection 
tasks  for  the  LH  anchoring  questions  no  matter  which  mode  of  presentations  the  subjects 
were  interpreting.  Tan  and  Benbasat  had  proposed  that  the  line  graphs  would  perform 
better.  However,  that  distinction  could  not  be  made. 

(4)  There  was  no  distinct  division  between  the  groups  performing  elementary  data 
collection  tasks  for  LL  anchoring  questions.  However,  subjects  interpreting  the  line 
graphs  spent  less  time  performing  these  tasks,  than  they  did  interpreting  the  other  modes 
of  presentation.  This  finding  supports  Tan  and  Benbasat’s  fourth  proposition.  It  was  also 
noted  that  subjects  (regardless  of  mode  of  presentation)  performing  LL  elementary  data 
collection  tasks  spent  more  time  than  with  any  other  task  anchoring  question. 

The  very  last  question  that  needs  to  be  answered  (investigative  question  eight)  is 
which  graphical  format  is  appropriate  for  a  given  task?  Tan  and  Benbasat  has  determined 
through  previous  research  which  graphical  format  is  most  appropriate  for  a  given  task,  and 
this  research  resulted  in  their  four  propositions.  However,  the  results  of  this  study  were 
somewhat  different  than  Tan  and  Benbasat’s  propositions. 

For  the  HH  anchoring  questions,  the  results  did  not  show  that  tables  and  bar  chans 
were  interpreted  faster.  As  a  matter  of  fact,  the  only  distinction  was  that  three- 
dimensional  line  graphs  took  the  longest  to  interpret.  Therefore,  according  to  these 
results,  three-dimensional  line  graphs  are  not  recommended  when  using  HH  anchoring 
questions. 

There  were  mixed  results  for  the  HL  anchoring  questions.  Tan  and  Benbasat  expect 
the  bar  charts  to  be  interpreted  faster,  however,  the  three-dimensional  bar  chan  took  the 
longest  to  interpret.  Thus,  three-dimensional  bar  chans  would  not  be  recommended 
(according  to  these  results)  for  HL  anchoring  questions. 
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All  of  the  modes  of  presentations  were  interpreted  relatively  the  same  for  the  LH 
anchoring  questions.  Tan  and  Benbasat  expected  the  line  graphs  to  be  the  fastest; 
however,  the  results  of  this  study  showed  no  difference.  Therefore,  any  of  the  modes  of 
presentations  could  be  used  for  the  LH  anchoring  questions. 

Subjects  interpreting  the  line  graphs  spent  less  time  performing  LL  anchoring 
questions,  than  they  did  interpreting  the  other  modes  of  presentation.  This  was  the  only 
result  which  verifies  Tan  and  Benbasat’s  proposition.  Therefore,  both  two-dimensional 
and  three-dimensional  line  graphs  are  recommended  when  using  LL  anchoring  questions. 

Limitations  of  the  Study 

This  study  is  limited  in  several  ways.  First,  the  results  of  the  study  are  only 
applicable  to  five  graphical  formats  investigated  in  our  research.  Future  researchers  may 
want  to  build  on  this  study  and  consider  additional  modes  of  presentation,  such  as 
horizontal  bar  chans,  pie  charts,  dot  chans,  Tukey  box  plots,  and  symbol  chans.  Second, 
the  task  complexity  was  relatively  simple.  This  resulted  in  high  levels  of  observed 
accuracy.  Future  researchers  could  examine  whether  or  not  the  task  anchoring 
propositions  hold  true  given  greater  task  complexity.  Finally,  although  color  was 
incorporated  into  the  experiment,  it  was  held  constant  and  was  not  considered  an 
independent  variable.  In  the  future,  the  effect  of  changing  color  on  both  accuracy  and 
speed  could  be  considered. 

Implications  of  the  Findings 

Although  this  study  is  limited  in  several  ways,  the  results  still  suggest  that  Tan  and 
Benbasat's  task  anchoring  concept  is  an  imponant  aspect  in  understanding  human 
processing  of  graphical  information.  This  study  suppons  their  conclusion  that  knowledge 
of  the  matching  relationship  between  task  anchoring  characteristics  and  mode  of 
presentation  can  provide  a  basis  for  choosing  between  graphical  formats.  The  implications 
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of  this  study  are  simple:  Graph  designers  and  decision-makers  must  be  trained  to  identify 
which  graph  is  appropriate  for  a  given  task.  Proper  training  will  not  only  result  in  more 
accurate  and  effective  decisions,  it  will  also  make  graphs  a  more  useful  form  of 
communicating  vast  amounts  of  information. 

The  DoD  is  an  organization  where  essential  decisions  must  be  made  by  managers  at 
all  levels  of  government.  Communication  and  the  transfer  of  necessary  information  is 
critical  to  our  national  defense.  The  data  presented  to  managers  is  often  in  the  form  of 
graphics  to  help  facilitate  decision  making  and  consolidate  enormous  quantities  of  data. 
The  results  attained  from  graphics  research  will  legitimately  aid  decision  makers  in 
understanding  data  formulation.  The  research  will  help  managers  understand  issues  such 
as  graph  characteristics,  which  modes  of  presentation  are  most  suitable  for  a  given  task 
question,  which  modes  of  presentation  have  the  lowest  comprehension,  and  which  modes 
of  presentation  are  the  most  time  consuming.  If  DoD  managers  are  educated  on  the  effect 
of  ill-prepared  graphics,  and  how  these  graphs  can  misrepresent  data,  they  will  be  given 
the  tools  to  become  even  better  decision  makers. 

In  conclusion,  there  is  still  much  work  to  be  done  in  evaluating  the  effect  of 
graphical  format  on  human  interpretation.  As  studies  continue  to  build  on  the 
understandings  of  graph  interpretation,  more  effective  and  more  useful  graphical  formats 
will  be  created. 
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Appendix  A.  Experimental  Item 


This  appendix  contains  a  copy  of  the  slides  that  were  displayed  on  the  computer 
screen  during  the  experiment.  Although  these  slides  are  black  and  white,  the  actual  slides 
were  displayed  in  color  during  the  experiment.  Pages  98-123  contain  the  slides  that  were 
shown  to  Group  1  (Gl),  while  Pages  124-149  contain  the  slides  that  were  shown  to 
Group  2  (G2). 

With  the  exception  of  the  introduction  slides  (Page  98  and  124),  the  slides  were 
presented  in  a  random  order.  To  facilitate  an  easy  review  of  the  experimental  item,  the 
slides  have  been  grouped  by  mode  of  presentation.  Within  each  group  the  charts  are  order 
by  task  (HH,  HL,  LH,  and  LL).  The  last  five  charts  of  each  group  (Pages  1 19-123  and 
145-149)  are  the  masking  charts.  The  masking  charts  were  used  to  hide  the  intent  of  the 
experiment  and  no  data  was  collected  for  them. 
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This  appendix  contains  the  slides  used  to  administer  the  end-of-exercise  ^ 

questionnaire.  Like  the  experimental  item  these  slides  were  displayed  on  the  computer 
screen  in  color.  The  subjects'  responses  to  these  questions  are  provided  in  Table  30. 
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The  purpose  of  this  appendix  is  to  provide  and  explain  the  macro  sheet  that  was  used 

* 

to  automate  the  experimental  item.  There  are  basically  two  parts  of  this  appendix.  Part  1 
(Pages  178-188)  is  an  example  of  the  macro  sheet  which  shows  the  current  value  of  each 
cell.  Since  the  macro  sheet  has  20  columns  and  304  rows,  it  takes  more  than  one  page  to 
print  it  out.  The  row  and  colunm  headings  are  provided  to  facilitate  the  explanation  and 
provide  a  reference  for  piecing  the  individual  pages  together.  Part  2  (Pages  189-210)  of 
this  appendix  is  a  very  valuable  reference  item  that  provides  the  acmal  formulas  that  are  in 
each  ceU  of  the  macro  sheet. 

A  macro  sheet  is  structured  like  a  spreadsheet.  It  is  made  up  of  cells  organized  in  to 
rows  and  columns.  Each  row  is  identified  by  a  number  while  each  column  is  identified  by 
a  letter.  For  example  the  first  row  is  Row  1,  the  second  is  Row  2,  the  third  is  Row  3,  etc. 

The  columns  are  label  the  same  way  starting  with  the  letter  A.  A  particular  cell  is  identified 
by  the  column  and  row  that  it  is  in.  For  example,  the  cell  in  the  upper  left  hand  comer  of  a 
sheet  is  cell  Al,  because  it  is  in  Column  A  and  Row  1 .  A  block  of  cells  are  identified  by 
the  cell  in  the  upper  left  hand  comer  and  the  cell  in  lower  right  hand  comer  of  the  block. 

For  example,  the  block  of  cells  containing  (Al,  A2,  Bl,  &  B2)  has  the  following  reference: 

A1..B2.  A  cell  can  contain  text  or  numerical  information  entered  directly,  or  it  can  contain 
a  formula  that  is  use  to  calculate  the  text  or  numerical  value  that  appears  in  the  cell. 

A  macro  is  simply  a  list  of  commands  that  the  computers  executes  one  after  another 
when  directed  to.  The  macro  used  it  this  experiment  starts  in  cell  Bl  and  continues  until 
cell  B3()4.  A  macro  is  mn  by  telling  the  computer  to  start  at  a  given  cell  (B 1  in  this  case)  an 
execute  each  command  it  encounters  until  it  is  directed  to  quit.  The  computer  performs  this 
function  by  starting  at  the  identified  cell,  executing  the  command  contained  in  that  cell,  and 
then  continues  to  the  following  cell  in  that  column.  If  it  does  not  encounter  the  quit 
command  before  it  reaches  the  end  of  the  column,  the  computer  will  continue  at  the  top  of 
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the  next  column.  It  will  proceed  in  this  manner  until  it  encounters  the  quit  command  or 
reaches  the  end  of  the  sheet. 

•  A  macro  command  is  easily  distinguished  from  other  cell  values  because  it  is  entirely 
contained  in  brackets:  {macro  command}.  A  cell  can  contain  more  than  one  command. 

»  Each  command  is  enclosed  in  a  separate  set  of  brackets: 

{ macro  command  1 }  { macro  command  2 }  { macro  command  3 }  etc. 

The  macro  sheet  used  in  this  experiment  has  five  distinct  sections: 

(1)  A  1..B 304  is  the  macro, 

(2)  D1..N25  is  use  by  the  macro  to  randomize  the  order  that  charts  are  presented, 

(3)  E29..K56  is  used  to  store  the  subjects  response  and  response  time, 

(4)  E150..0208  contains  the  data  set  used  to  create  the  graphs, 

(5)  The  chart  page  which  contains  all  of  charts  to  be  displayed. 

The  following  discussion  will  start  with  an  explanation  of  the  chart  page  and  the  data 
section  of  the  macro  sheet  (E150..0208),  and  then  cover  the  other  three  sections  of  the 
macro  sheet  as  they  relate  to  each  other. 

In  addition  to  being  an  excellent  spread  sheet  application,  Quatro  Pro  is  designed  to  be 
a  briefing  tool.  It  gives  the  user  the  ability  to  create  all  the  slides  required  to  give  a  briefing 
and  store  them  as  part  of  the  document  they  are  working  on.  Briefing  slides  can  contain 
charts  generated  from  data  contained  in  the  spreadsheet,  or  normal  text  slides.  The  chart 
page  is  used  to  create  briefing  slides.  After  creating  a  slide  it  can  be  given  a  name  and 
saved.  A  slide  that  has  been  saved  shows  up  as  an  icon  on  the  chart  page.  This  capability 
was  use  to  generate  and  save  all  of  the  slides  required  for  the  experiment.  Appendix  ?? 

♦  contains  all  of  the  slides  used  in  this  experiment.  The  graphs  in  these  slide  were  generated 
from  the  various  data  sets  contained  in  EI50..0208  of  the  macro  sheet.  Once  the  slides 

^  were  created  and  saved  to  the  chart  page,  macro  commands  could  be  used  to  display  them 

at  the  appropriate  time. 
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As  stated  previously  the  macro  for  the  experiment  is  contained  in  cells  B 1  ..B304.  The 
macro  performs  five  basic  tasks.  First,  it  sets  up  a  controlled  operating  environment  for  the 
experiment.  It  does  this  by  disabling  all  of  the  menus  and  interrupt  keys  (break,  esc,  etc.).  4 

It  also  hides  the  macro  sheet  and  turns  off  normal  screen  updating.  Second,  it  randomizes 
the  order  in  which  charts  are  to  be  presented.  Third,  the  macro  presents  the  charts  based  on  ^ 

the  randomized  order,  captures  the  subjects  response  and  response  time,  and  then  stores  the 
data  in  the  response  section  (E29..K56).  Fourth,  the  macro  presents  the  end  of  exercise 
questionnaire  slides  and  then  captures  and  stores  the  subjects  response.  Finally,  the  macro 
restores  the  operating  environment  to  its  original  state  and  writes  the  results  of  the 
experiment  to  a  text  file.  The  text  files  was  used  to  consolidate  the  data  and  import  the 
results  in  to  various  statistical  applications. 

To  save  time,  the  button  "Main"  was  created  so  that  the  macro  could  be  executed  by 
simply  clicking  on  the  button  with  the  mouse.  Since  cell  references  can  be  cumbersome,  it 
often  easier  to  give  a  cell  a  name,  and  then  refer  to  that  cell  by  using  the  name  instead  of 
using  the  column-row  reference.  Whenever  a  cell  was  given  a  name  in  the  macro  sheet,  the 
name  was  provided  in  the  cell  immediately  to  its  left.  For  example,  cell  B21  was  given  the 
name  "Chart  1".  To  document  this  fact  the  text  "Chart  1"  was  place  in  cell  A21. 

The  following  discussion  of  the  macro  will  provide  cell  references  and  discuss  what 
functions  those  cell  are  performing. 

B 1 :  Turns  off  normal  screen  updating. 

B2..B  10:  Hides  the  menus. 

B 1 1 :  Disables  interrupt  keys. 

B 1 2..B  16:  These  cell  sort  the  cell  block  E1..L25  by  rows  based  on  the  values  ^ 

contained  in  column  E.  Cells  El. .El  1  and  E15..E25  contain  a  formula 
that  generates  a  random  number.  When  the  block  is  sorted  according  the 
values  in  column  E,  the  order  of  the  rows  are  effectively  randomized.  The 
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information  in  these  row  will  be  used  by  the  macro  to  present  the  charts. 
This  ensures  that  the  charts  will  be  presented  in  a  randomized.  Cells 
E12..E14  contain  the  numbers  1,0,&  -1  respectively.  This  ensures  that 
the  these  three  masking  charts  are  always  presented  in  the  same  order 
when  the  subjects  are  half-way  through  the  experiment. 

B 1 7 ;  Hides  the  macro  sheet. 

B 18:  Adds  the  menu  defined  in  the  cell  range  "menuid"  (cell  P4).  It  takes  the 
computer  a  second  or  two  to  load  and  display  the  next  slide  in  the 
presentation.  During  this  time  the  subjects  see  the  an  empty  window  and 
the  menu  bar.  This  command  places  the  word  "Processing..."  on  the 
menu  bar.  The  purpose  is  to  simply  add  a  nice  effect  while  the  subjects 
are  waiting  for  the  next  slide. 

B 19:  Displays  the  slide  called  "start"  from  the  chart  page.  This  slide  provides 
the  introduction  to  the  experiment.  When  subjects  arrive  to  take  the 
experiment  this  slide  is  already  on  the  screen.  Thus,  the  macro  has 
already  completed  the  commands  in  cell  B 1  ..B 19.  When  the  macro 
displays  a  slide,  it  will  not  continue  until  a  key  is  pushed.  After  the 
subjects  read  this  slide  they  continue  the  experiment/macro  by  pressing 
any  key. 

B20..B26:  These  cells  are  responsible  for  presenting  the  first  chart  of  the  experiment, 
and  capturing  and  recording  the  subjects  response  and  response  time. 

The  commands  required  to  perform  these  tasks  are  in  the  first  row  of  the 
block  E1..N25.  Remember,  columns  E  through  L  of  this  block  were 
randomized  earlier.  This  means  that  the  order  in  which  charts  are 
presented  is  random.  Ceil  B20..B26  are  filled  with  formulas  that 
reference  the  first  row  of  the  block  E1..N25.  For  example,  B20  has  the 
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formula  "+F1 This  formula  sets  the  value  of  B20  equal  to  the  value  of 
FI.  Since  FI  is  contains  the  command  "[LET  I141,@NOW:VALUE}", 
this  same  command  appears  in  cell  B20.  The  macro  then  executes  that 
command  when  it  gets  to  B20. 

B20:  Captures  the  current  time  and  places  it  in  column  of  I  of  the  response 
section.  The  row  it  is  placed  in  corresponds  to  the  chart  that  is  being 
displayed.  This  command  effectively  captures  when  the  chart  is  initially 
displayed. 

B21:  Contains  the  formula  "+01".  The  command  in  G1  displays  one  of  the 
graphs.  Due  to  the  random  sort  this  chart  is  the  first  to  be  displayed. 

B22:  Contains  the  formula  "+Hr’.  This  command  captures  the  key  stroke  the 
subject  pushed  to  clear  the  chart  and  stores  in  the  appropriate  cell  in 
column  G  of  the  response  section.  Each  slide  contained  a  question  with 
four  response.  The  subjects  were  instructed  to  press  the  number  key 
(1,2,3,  or  4)  that  corresponded  to  their  answer  to  question.  Upon 
pressing  the  key,  the  slide  was  cleared  and  the  answer  was  recorded. 

B23:  Contains  the  formula  "+H".  The  command  in  II  captures  the  current  time 
and  places  it  the  appropriate  cell  in  column  J  of  the  response  section.  This 
is  the  time  when  the  subject  has  given  a  valid  response  to  the  slide.  The 
column  K  of  the  response  section  contains  a  formula  that  subjects  the  time 
in  column  I  from  the  time  in  column  J.  This  is  the  subjects  response  time 
for  the  slide. 

B24:  Contains  the  formula  "+L1",  The  command  in  LI  checks  to  see  if  the 
subjects  response  is  a  If  it  is,  the  macro  branches  to  the  cell  name 
"ShowMenu".  The  purpose  of  this  is  to  allow  the  researchers  to  interrupt 
the  experiment  if  necessary. 


* 


« 


B25: 


B26: 


B27..B194: 


B195: 


B196..B280: 


Contains  the  formulas  "+Jl&Ml&Nr’.  This  formula  places  the  three 
commands  in  Jl,  Ml,  and  N1  in  to  cell  B25.  These  commands  check  to 
see  if  the  subjects  response  is  less  the  1.  If  it  is,  the  response  is  not  valid. 
To  remedy  the  situation  the  subjects  are  shown  a  warning  message 
identified  by  cells  P1..T2.  The  message  reniinds  the  subject  that  the 
response  must  be  a  number  between  1  and  4.  The  macro  then  branches  to 
the  cell  named  "Chart  1".  This  allows  the  chart  currently  being  considered 
to  be  displayed  again. 

Contains  the  formulas  "+K1&M1&N1".  This  formula  places  the  three 
commands  in  Kl,  Ml,  and  Nl  in  to  cell  B26.  These  commands  check  to 
see  if  the  subjects  response  is  greater  than  4.  If  it  is,  the  response  is  not 
valid.  To  remedy  the  situation  the  subjects  are  shown  a  warning  message 
identified  by  cells  P1..T2.  The  message  reminds  the  subject  that  the 
response  must  be  a  number  between  I  and  4.  The  macro  then  branches  to 
the  cell  named  "Chart  1".  This  allows  the  chart  currently  being  considered 
to  be  displayed  again. 

These  cells  are  similar  in  function  to  B20..B26.  For  example,  B27..B34 
displays  the  second  chart  with  the  commands  from  the  second  row  of  the 
randomization  section.  This  pattern  is  repeated,  until  all  of  the 
experimental  s.ides  have  b^n  shown. 

Display  the  slide  "Qstart".  This  slides  informs  the  subjects  that  they  have 
completed  the  experiment  and  that  the  end  of  exercise  questionnaire  is 
next. 

The  commands  in  these  cell  are  similar  to  those  used  in  B20..B194.  The 
difference  is  that  the  cells  do  not  contain  references.  Because  the  order  of 
the  questions  for  the  end  of  exercise  questionnaire  is  fixed  so  the  cells  can 
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B281..B282: 


B285..B296: 

B297; 

B298: 


B299: 


contain  the  actual  commands.  The  commands  in  these  cells  display  the 
slides  that  contained  the  end  of  exercise  questions  and  capture  the  subjects 
response.  If  the  response  is  valid,  it  is  recorded  in  survey  response 
section,  E57..F74.  If  not,  the  slide  containing  the  question  under  current 
consideration  is  re-displayed. 

Displays  the  final  slide.  If  the  next  key  stroke  is  not  a is  re-display 
this  same  slide.  This  allows  the  researchers  to  exit  the  macro  under 
controlled  conditions. 

Returns  the  operating  environment  to  its  initial  state. 

Reserved  line. 

Ensure  the  calculations  in  the  response  section  are  performed.  Colunm  F 
of  the  response  section  contains  the  correct  answer  to  the  question  asked 
on  each  chart.  Column  G  contains  the  response  give  by  the  subject. 
Column  H  contains  the  formula  that  compares  the  values  of  Columns  F 
and  G.  If  the  values  are  the  same,  the  formula  returns  a 'T If  they  are 
not,  it  returns  a  "0".  Thus,  a  in  "1"  in  Colunm  H  means  the  question  was 
answered  correctly.  The  other  part  of  the  response  section  is  to  calculate 
the  response  time.  Column  I  contains  the  time  when  a  graph  is  initially 
displayed.  Column  J  contains  the  time  when  the  subject  answered  the 
question  for  that  chart.  The  response  time  in  Column  K  is  calculated  by 
subtracting  Column  I  from  Column  J. 

Contains  the  formula  "+C297&@STRING(C298,0)&C299".  This 
formula  opens  a  new  file  on  drive  A.  The  file  is  given  a  name  with  the 
”.txt"  extension.  The  last  three  characters  of  the  name  are  the  Julian  date 
for  the  day  the  experiment  was  given.  The  fourth  character  from  the  end 
is  an  underscore.  The  characters  at  the  beginning  of  the  name  identify  the 
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disk  that  the  experiment  was  run  from  (SI,  S2,  S3,  etc.).  This  method  of 
naming  text  file  provided  the  researchers  with  the  date  and  the  disk  the 
results  were  from.  If  there  had  been  a  problem,  this  information  might 
would  have  helped  in  identifying  the  source. 

B300..B302:  Writes  the  results  store  in  the  response  section  to  the  newly  created  file. 

B303:  Closed  the  results  text  file. 

B3()4:  Ends  the  macro. 

Finally,  Dr.  Dave  Christensen  maintains  a  disk  copy  of  the  experimental  item.  If  you 
would  like  a  copy,  please  contact  him  at  AFTT/LAS  Bldg  641, 2950  P  St,  Wright- 
Patterson  AFB  OH  45433-9905. 
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DATA  SET  11 

MT,MB2 

151 

NORTH  SOUTH 

EAST 

WEST 

NORTH SOUTH 

EAST 

WEST 

152 

1987 

371.00 

596.00 

679.00 

905.00 

1 

516.00 

156.00 

224.00 

79.00 

153 

1988 

399.00 

432.00 

749.00 

692.00 

2 

131.00 

880.00 

460.00 

873.00 

154 

1989 

531.00 

379.00 

632.00 

700.00 

3 

800.00 

241.00 

329.00 

975.00 

155 

1990 

442.00 

343.00 

556.00 

648.00 

4 

527.00 

469.00 

413.00 

262.00 

156 

1991 

507.00 

398.00 

620.00 

540.00 

5 

253.00 

870.00 

133.00 

506.00 

157 

1992 

691.00 

556.00 

730.00 

489.00 

6 

399.00 

518.00 

877.00 

275.0C 

158 

1993 

589.00 

353.00 

858.00 

759.00 

7 

98.00 

528.00 

252.00 

267.00 

159 

160 

DATA  SET  12 

MB3 

161 

NORTH  SOUTH 

EAST 

WEST 

NORTH SOUTH 

EAST 

WEST 

162 

JAN 

71.00 

296.00 

379.00 

605.00 

JAN 

874.00 

810.00 

793.00 

474.00 

163 

FEB 

99.00 

132.00 

449.00 

392.00 

FEB 

740.00 

573.00 

895.00 

783.00 

164 

MAR 

231.00 

79.00 

332.00 

400.00 

MAR 

169.00 

786.00 

504.00 

920.00 

165 

APR 

142.00 

43.00 

256.00 

348.00 

APR 

268.00 

167.00 

332.00 

466.00 

166 

MAY 

207.00 

98.00 

320.00 

240.00 

MAY 

500.00 

181.00 

359.00 

483.00 

167 

JUN 

391.00 

256.00 

430.00 

189.00 

JUN 

89.00 

895.00 

661.00 

250.00 

168 

JUL 

289.00 

53.00 

558.00 

459.00 

JUL 

279.00 

190.00 

151.00 

942.00 

169 

170 

DATA  SET  13 

ML2 

171 

NORTH SOUTH 

EAST 

WEST 

NORTH SOUTH 

EAST 

WEST 

172 

1980 

94 

394 

504 

805 

1 

282.00 

176.00 

819.00 

108.00 

173 

1981 

132 

176 

597 

521 

2 

267.00 

701.00 

56.00 

179.00 

174 

1982 

307 

105 

442 

532 

3 

407.00 

20.00 

692.00 

333.00 

175 

1983 

189 

57 

340 

463 

4 

913.00 

463.00 

580.00 

440.00 

176 

1984 

275 

130 

426 

319 

5 

501.00 

702.00 

911.00 

481.00 

177 

1985 

520 

340 

572 

251 

6 

655.00 

330.00 

759.00 

264.00 

178 

1986 

384 

70 

742 

610 

7 

553.00 

274.00 

443.00 

213.00 

179 

180 
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NORTH  SOUTH 

EAST 

WEST 

NORTH SOUTH 

EAST 

WEST 

182 

JUN 

24 

98 

126 

201 

JAN 

848.00 

943.00 

227.00 

413.00 

183 

JUL 

33 

44 

149 

130 

FEB 

790.00 

859.00 

849.00 

516.00 

184 

AUG 

77 

26 

110 

133 

MAR 

190.00 

257.00 

162.00 

869.00 

185 

SEP 

47 

14 

85 

116 

APR 

920.00 

351.00 

942.00 

555.00 

186 

OCT 

69 

33 

106 

80 

MAY 

217.00 

752.00 

922.00 

949.00 

187 

NOV 

130 

85 

143 

63 

JUN 

57.00 

923.00 

675.00 

636.00 

188 

DEC 

96 

18 

186 

153 

JUL 

778.00 

38.00 

575.00 

775.00 

189 

190 
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885.00 

945.00 

583.00 

430.00 

1980 

778 

858 

376 

173 

193 

1988 

805.00 

695.00 

553.70 

559.00 

1981 

672 

525 

337 

344 

194 

1989 

619.00 

463.05 

519.00 

726.70 

1982 

424 

217 

291 

568 

195 

1990 

563.75 

324.14 

503.87 

826.00 

1983 

351 

32 

271 

700 

196 

1991 

732.87 

421.38 

352.71 

661.30 

1984 

576 

161 

70 

481 

197 

1992 

513.01 

547.79 

458.52 

759.00 

1985 

283 

330 

211 
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666.91 

637.00 

584.00 

905.00 

1986 

488 

448 
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395  00 
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259.00 

MAR 

319.00 

163.05 

219.00 

426.70 

APR 

263.75 

24.13 

203.87 

526.00 

MAY 

432.87 

121.38 

52.71 
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247.79 
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A:A1 :  'Main 

A:B1 :  '{APPLICATION.DISPLAY  -none.no.no.no.a..b:a1 

A:D1:  @RAND 

A:E1 :  @ROUND(@RAND*1 000.0)*@IF(D$1  <0.5.-1 . 1 ) 

A:F1;  '{LET  l35.@NOW:VALUF} 

A:G  1 :  '{graphview  b2hh} 

A.H1 .  '{GRAPHCHAP.  G35} 

A:I1:  •{LETJ35,@NOW:VALUE} 

A:J1:  '{if  @@(-G35-)<"n 

A:K1:  '{if  @<i>rG35")>"4"} 

A;L1 ;  '{if  @@v''G35'')=''~i{Branch  ShowMenu} 

A:M1 :  '{BEEP}{Message  Msg.28, 1 3,0} 

A:N1 ;  '{Branch  Chartf } 

A:01 ;  'Msg 

A:P1 :  'Your  Response  Must  Be  a  Number 

A:B2:  '{setobjectproperty  "/File.hidden’.'yes'} 

A;D2:  @RAND 

A:E2:  @ROUND(@RAND*1 000.0)*@IF(D$2<0.5,-1 . 1 ) 

A:F2:  '{LET  l37.@NOW:VALUE} 

A:G2;  '{graphview  b2lh} 

A:H2:  '{GRAPHCHAR  G37} 

A:I2:  '{LET  J37.@NOW:VALUE} 

A:J2;  '{if  @@(''G37*)<''n 

A:K2;  '{if  @@{''G3r)>''4'l 

A:L2:  '{if  @@(''G37’)=''~'1{Branch  ShowMenu} 

A:M2:  '{BEEP}{Message  Msg,28, 1 3,0} 

A:N2:  '{Branch  Chart2} 

A:P2:  'Between 

A:Q2:  -'1 

A:R2:  "and 

A:S2:  M 

A;T2:  "Please,  Try  Again. 

A:B3:  '{setobjectproperty  "/EDIT.hidden","yes"} 

A:D3;  @RAND 

A;E3;  @RCXJND(@RAND"1 000,0)*@IF(D$3<0.5,-1 ,1 ) 

A:F3:  '{LET  I40,@NOW;VALUE} 

A:G3:  '{graphview  b3hl} 

A:H3:  '{GRAPHCHAR  G40} 

A:I3:  '{LETJ40,@NOW:VALUE} 

A:J3:  '{if  @@("G40")<"1"} 

A:K3:  '{if  @@("G40")>"4"} 

A:L3:  '{if  @@("G40")="~"}{Branch  ShowMenu} 

A:M3:  '{BEEP}{Message  Msg,28,13,0} 

A:N3;  '{Branch  Chart3} 

A;B4-.  '{setobjectproperty  "/BLOCK.  hidden","yes''} 

A:D4:  @RAND 

A:E4:  @ROUND(@RAND*1000,0)*@IF(D$4<0.5,-1,1) 

A:F4:  '{LET  l42,@NOW:VALUE} 

A:G4:  '{graphview  b3ll} 

A:H4;  '{GRAPHCHAR  G42} 

A;I4:  '{LET  J42,@NOW:VALUE} 

A:J4;  '{if  @@("G42")<"1 "} 

A:K4;  '{if  @@("G42")>"4"} 

A:L4:  '{if  @@("G42")="-"} {Branch  ShowMenu} 

A;M4;  '{BEEP}{Message  Msg,28, 1 3,0} 

A;N4;  '{Branch  Chart4} 

A;P4:  'Menu  Processing ... 

A:B5:  '{setobjectproperty  "/DATA.hidden","yes"} 

A:D5:  @RAND 

A:E5;  @ROUND(@RAND*1000.0)*@IF(D$5<0.5,-1,1) 

A:F5;  '{LET  I43,@N0W:VALUE} 
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A:G5: 

■{graphview  12hh} 

A:H5; 

•{GRAPHCHAR  G43} 

A:I5: 

•{LET  J43.@NOW:VALUE} 

A;J5: 

•{if  @@(-G43“)<-1-} 

A;K5-. 

•{if  @@(-G43-)>-4-} 

A:L5; 

•{if  @@(-G43")=-~"}{Branch  ShowMenu} 

AM5: 

•{BEEP}{Message  Msg,28,13.0} 

A:N5: 

•{Branch  Charts} 

A:05: 

•Msg2 

A:P5: 

That  is  Not  a  Vaiid  Response. 

A:B6: 

•{setobjectproperty  "/TOOLS.hidden’.'yes"} 

A:D6: 

@RAND 

A;E6: 

@ROUND{@RANDT  000,0)*(i)IF(D$6<0.5.-1 .1 ) 

A:F6: 

•{LET  l45.@NOW:VALUE) 

A:G6: 

•{graphview  I2lh} 

A:H6: 

•{GRAPHCHAR  G45} 

A:16: 

•{LET  J45,@NOW;VALUE} 

A:J6: 

•{if  @@CG45')<-1-} 

A:K6: 

•{if  @@CG45-)>’4'^ 

A:L6; 

•{if  @@("G45’)=-~*}{Branch  ShowMenu} 

A:M6; 

•{BEEP}{Message  Msg.28,13,0} 

A:N6: 

•{Branch  Charts} 

A;P6: 

"Please,  Try  Again. 

A:B7: 

'{setobjectproperty  "/GRAPH.hidden","yes"} 

A:D7: 

@RAND 

A:E7; 

@ROUND(@RAND*1000,0)*@IF(D$7<0.5,-1,1) 

A:F7: 

•{LET  l48,@NOW:VALUE} 

A;G7: 

•{graphview  i3hl} 

A.H7; 

•{GRAPHCHAR  G48} 

A;I7; 

•{LET  J48.@NOW:VALUE} 

A:J7: 

•{if@@("G48")<"1’} 

A:K7: 

•{if  @@("G48')>*4*} 

A;L7: 

•{if  @@("G48")=*~"}{Branch  ShowMenu} 

A;M7: 

•{BEEP}{Message  Msg.28,13.0} 

A:N7; 

•{Branch  ChartT} 

A;B8: 

•{setobjectproperty ’/PROPERTY.hidden", "yes"} 

A:D8: 

@RAND 

A;E8: 

@ROUND(@RAND*1 000.0)*@IF(Df  3<0.5,-1 .1 ) 

A:F8: 

•{LET  I50.@NOW:VALUE} 

A;G8: 

’{graphview  1311} 

A:H8; 

•{GRAPHCHAR  G50} 

A:I8: 

•{LET  J50,@NOW:VALUE} 

A:J8: 

•{if  @@("G50")<"1"} 

A:K8: 

•{if  @@(-G50")>"4"} 

A;L8: 

•{if  @>(S)fG50")="~"}{Branch  ShowMenu} 

A:M8; 

•{BEEP}{Message  Msg,28.13,0} 

\;N8: 

•{Branch  Chart8} 

A:B9: 

•{setobjectproperty  "/WINDOW.hidden","yes"} 

A:D9: 

@RAND 

A:E9: 

@ROUND(@RAND*1 000.0)*@IF(D$9<0.5.-1 .1 ) 

A:F9: 

•{LET  I52.@N0W:VALUE} 

A:G9: 

•{graphview  mb2} 

A:H9: 

•{GRAPHCHAR  G52} 

A:I9: 

•{LET  J52.@NOW:VALUE} 

A:J9: 

•{if  @@("G52")<"1"} 

A:K9: 

•{if  @@("G52")>'4"} 

A:L9: 

•{if  @@("G52")="~"}{Branch  ShowMenu} 

A:M9: 

•{BEEP}{Message  Msg,28.13,0} 

A:N9; 

•{Branch  Chart9} 

A:B10; 

•{setobjectproperty  "/HELP.hidden","yes"} 

A:D10: 

@RAND 
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A:E1 0:  @ROUND(@RAND*1 000.0)*@IF(D$1 0<0.5.-1 .1 ) 

A:F1 0:  '{LET  Bl  .@NOW:VALUE} 

A:G10:  ‘{graphview  thh} 

A;H10:  ’{GRAPHCHAR  G31} 

A:I10:  •{LETJ31.@NOW;VALUE} 

A:J10:  •{if@@(’G31’)<"r} 

A:K10:  '{if  @@(*G3r)>"4-} 

A:L1 0:  '{if  @@{*G31  “)="~'^{Branch  ShowMenu} 

A:M10:  '{BEEPlfMessage  Msg.28.13,0} 

A:N10:  '{Branch  ChartIO} 

A:B11:  '{braakoff} 

A:D11:  @RANO 

A:E1 1 :  @ROUND(@RAND*1 000.0)*@IF(D$1 1  <0.5.-1 .1 ) 

A:F1 1 :  '{LET  B3.@NOW;VALUE} 

A:G1 1 :  '{graphview  tih} 

A:H1 1 :  '{GRAPHCHAR  G33} 

A:I11:  ’{LETJ33.@NOW:VALUE} 

A:J11:  '{if  @@(''G33'')<’'r} 

A:K11:  '{if  @@(''G33'')>-4''} 

A:L1 1 :  '{if  @@(''G33'')=''--'1{Branch  ShowMenu} 

A:M1 1 ;  '{BEEP}{Message  Msg, 28, 1 3,0} 

A:N1 1 :  '{Branch  Chart!  1 } 

A:A12:  'Sort 

A:B12:  '{sort.reset} 

A:E12;  -1 

A:F12:  '{LET  154,@N0W:VALUE} 

A;G12:  '{graphview  ml2} 

A:H12:  '{GRAPHCHAR  G54} 

A:I12;  ■{LETJ54.@NOW:VALUE} 

A:J12;  '{if  @@rG54*)<’n 

A;K12:  '{if  @@(''G54’)>’4''} 

A:L1 2:  '{if  @@(*G54'')=''-'1{Branch  ShowMenu} 

A:M12;  '{BEEP}{Message  Msg,28,13,0} 

A;N12:  '{Branch  Chart!  2} 

A:B!3;  '{sort.block  e!  ..125} 

A;E!3:  0 

A:F!  3;  '{LET  15!  ,@NOW;VALUE} 

A;G!3:  '{graphview  mt} 

A;H!  3:  '{GRAPHCHAR  G5! } 

A:l!3:  '{LET  J5!  .@NOW:VALUE} 

A:J!3;  '{if  @@(''G5!'')<''!'^ 

A:K!3:  '{if  @@(''G5!  >■'4'^ 

A:L!  3;  '{if  @@(''G5!  '•)=’~'7{Branch  ShowMenu} 

A:M!3:  '{BEEP}{Message  Msg,28,!3,0} 

A:N!3;  '{Branch  Chart!  3} 

A:B!4:  '{sort.key_!  e!} 

A;E!4:  ! 

A:F!4;  '{LET  l55,@NOW:VALUE} 

A;G !  4:  '{graphview  ml3} 

A:H!4:  '{GRAPHCHAR  G55} 

A:l!4;  '{LETJ55,@NOW;VALUE} 

A:J!4:  •{if@@(''G55'')<"!'^ 

A:K!4:  '{if  @@(''G55’)>’4'^ 

A:L!  4:  '{if  @@rG55'')=''~'}{Branch  ShowMenu} 

A;M!4:  '{BEEP}{Message  Msg,28,!3,0} 

A:N!4;  '{Branch  Chart!  4} 

A;B!5:  '{sort.order_!  ascending} 

A:E!  5:  @ROUND(@RAND*!  000,0)*@IF(D$7<0.5,! ,-! ) 

A:F!5;  '{LET  l36,@NOW:VALUE} 

A:G !  5:  '{graphview  b2hl} 

A:H!  5:  '{GRAPHCHAR  G36} 
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A:I15: 

A;J15: 

A:K15: 

A:L15; 

A;M15: 

A:N15: 

A:B16: 

A:E16: 

A;F16: 

A:G16: 

A:H16; 

A:I16; 

A:J16: 

A:K16: 

A;L16: 

A;M16: 

A:N16; 

A;B17: 

A:E17: 

A:F17: 

A;G17: 

A:H17; 

A:I17: 

A;J17: 

A;K17; 

A:L17: 

A:M17: 

A:N17; 

A:B18: 

A:E18: 

A:F18: 

A:G18: 

A:H18: 

A;I18: 

A;J18: 

A:K18: 

A:L18: 

A:M18; 

A:N18: 

A:B19: 

A;E19: 

A:F19: 

A:G19; 

A:H19; 

A:I19: 

A:J19: 

A:K19: 

A:L19: 

A:M19; 

A:N19: 

A;B20: 

A:E20: 

A:F20: 

A:G20: 

A:H20: 

A:I20: 

A:J20: 

A;K20: 

A:L20: 

A:M20; 

A:N20: 


•{LET  J36.@NOW:VALUE} 

•{if  @@(-G36-)<-1-} 

■{if  @@(-G36-)>-4-} 

•{if  @@("G36")=*~^^{Branch  ShowMenu} 
•{BEEP}{Message  Msg.28,13,0} 

•{Branch  Chartl5} 

•{sort.go} 

@ROUND(@FIAND*1 000,0)*@IF(D$8<0.5,1  .-1 ) 
•{LET  I38.@N0W:VALUE} 

•{graphview  b2ll} 

•{GRAPHCHAR  G38} 

•{LETJ38.@NOW:VALUE} 

•{if  @@(-G38")<”n 
•{if  @@CG38-)>’4-i 

•{if  @@("G38’)*’-i{Branch  ShowMenu} 
•{BEEP}{Message  Msg,28,13,0} 

•{Branch  Chart16} 

•{Windowhide} 

@ROUND(@RAND*1 000.0)*@IF(D$5<0.5. 1,-1) 
•{LET  l39.@NOW:VALUE} 

•{graphview  b3hh} 

•{GRAPHCHAR  G39} 

•{LET  J39.@NOW;VALUE} 

•{if  @@(-G39-)<-11 
•{if  @@(-G39’)>-4-} 

•{if  @@CG39'0=’~^^{Branch  ShowMenu} 
•{BEEP}{Message  Msg, 28,1 3,0} 

•{Branch  ChartIT} 

’{addmenu  /file,  menuid} 

@ROUND(@RAND*1 000,0)*@IF(D$6<0.5.1  ,-1 ) 
•{LETI41,@NOW:VALUE} 

•{graphview  b3lh} 

•{GRAPHCHAR  G41} 

•{LETJ41,@NOW:VALUE} 

•{if  @@(’G41-)<-n 

•{if  @@(-G41-)>-4-} 

•{if  @@("G4n="~^7{Branch  ShowMenu} 
•{BEEP}{Message  Msg,28,13.0} 

•{Branch  Chartl8} 

•{graphview  start} 

@ROUND(@RAND*1 000,0)*(i)IF(D$3<0.5,1  ,-1 ) 
•{LET  l44.@NOW:VALUE} 

•{graphview  I2hl} 

•{GRAPHCHAR  G44} 

•{LET  J44,@NOW:VALUE} 

•{if  @@CG44-)<-1-} 

•{if  @@(-G44-)>-4-} 

•{if  @@("G44*)=*~^^{Branch  ShowMenu} 
•{BEEP}{Message  Msg,28.l3,0} 

•{Branch  Chart19} 

+F1 

@ROUND(@RAND*1 000.0)*@IF(D$4<0.5,1  .-1 ) 
•{LET  l46.@NOW:VALUE} 

•{graphview  1211} 

•{GRAPHCHAR  G46} 

•{LET  J46,@NOW:VALUE} 

•{if  @@(-G46-)<-1-} 

•{if  @@(-G46-)>"4-} 

•{if  @@("G46")="~'^{Branch  ShowMenu} 
•{BEEP}{Message  Msg,28,13,0} 

•{Branch  Chart20} 


ft 


ft 
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■* 


A:A21; 

A:B21: 

A:E21; 

A:F21; 

A:G21: 

A:H21: 

A:I21: 

A:J21: 

A:K21: 

A;L21: 

A:M21: 

A:N21: 

A:822; 

A;E22: 

A:F22: 

A;G22: 

A:H22: 

A:I22: 

A;J22: 

A:K22: 

A;L22; 

A:M22; 

A:N22: 

A:B23: 

A:E23: 

A:F23: 

A:G23: 

A:H23; 

A:I23: 

A:J23; 

A;K23: 

A:L23: 

A:M23: 

A:N23: 

A;B24; 

A:E24; 

A:F24; 

A:G24: 

A;H24: 

A:I24: 

A:J24: 

A:K24: 

A:L24: 

A:M24; 

A:N24: 

A:B25: 

A:E25: 

A;F25: 

A:G25. 

A:H25: 

A:I25; 

A:J25; 

A:K25: 

A:L25; 

A:M25: 

A:N25: 

A:B26; 

A;B27; 

A:A28; 

A:B28: 

A:B29: 


'Chartl 

+G1 

@R0UND((§>RAND*1 000,0)*@IF(D$1  <0.5,1  ,-1) 
•{LET  I47,@N0W:VALUE} 

'{graphview  I3hh} 

•(GRAPHCHAR  G47} 

•{LET  J47.@NOW:VALUE} 

•{»  @@(’G47*)<-1-} 

•{if  @@(-G4r)>-4-} 

•{if  @@CG4r)=-~^^{Branch  ShowMenu} 
•{BEEP}{Message  Msg, 28,1 3,0} 

•{Branch  Chart21} 

+H1 

@R0UND(@RAND*1 000,0)*@IF(D$2<0.5,1  ,-1) 
•{LET  I49,@N0W:VALUE} 

'{graphview  I3lh} 

•{GRAPHCHAR  G49} 

•{LET  J49,@NOW:  VALUE) 

•{if  @@(-G49-)<-n 

•{»  @@(-G49-)>"4-} 

'{if  @@(’G49")=''~'i{Branch  ShowMenu} 
'{BEEP}{Message  Msg,28,13,0} 

'{Branch  Chart22} 

+11 

@ROUND(@RAND*1 000,0)*@IF(D$9<0.5,1  ,-1 ) 
•{LET  l53.@NOW;VALUE} 

'{graphview  mb3} 

•{GRAPHCHAR  G53} 

•{LET  J53,@NOW:VALUE} 

•{if  @@(-G53-)<''1-} 

•{if  @@(''G53-)>"4*} 

•{if@@('G53')^"-'}{Branch  ShowMenu} 
•{BEEP}{Message  Msg,28,13,0} 

'{Branch  Chart23} 

+L1 

@ROUND(@RAND*1 000,0)'<i>IF(D$1 0<0.5, 1,-1) 
'{LET  J32,@NOW:VALUE} 

'{graphview  thi} 

•{GRAPHCHAR  G32} 

•{LET  J32,@NOW:VALUE} 

•{if  @@CG32'')<"1-} 

’{if  @@(-G32')>’'4’^ 

'{if  @@(''G32'')=''--1{Branch  ShowMenu} 
•{BEEP}{Message  Msg,28,13,0) 

’{Branch  Chart24} 

+J1&M1&N1 

@ROUND(@RAND*1 000,0)*@IF(D$1 1  <0.5,1  ,-1 ) 
•{LET  l34,@NOW;VALUE} 

•{graphview  tii} 

•{GRAPHCHAR  G34} 

•{LETJ34,@NOW:VALUE} 

•{if  @@(-G34-)<''r} 

•{if  @@(-G34-)>''4-} 

'{if  @@(''G34'^=''~i{Branch  ShowMenu} 
'{BEEP}{Message  Msg,28,l3,0} 

’{Branch  Chaft25} 

+K1&M1&N1 

+F2 

•Chart2 

+G2 

+H2 
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A:E29: 

•RESPONSE  SECTION 

A:B30: 

-»-l2 

A;E30: 

NAME 

A:F30: 

''KNOWN 

A:G30: 

''OBSRVD 

A:H30; 

''CORCT 

A;I30: 

''TIME  ST 

A;J30; 

''TIME  END 

A:K30: 

''RESPTIME 

A;B31: 

+L2 

A:E31 : 

THH 

A:F31: 

A3 

A:G31 : 

'3 

A:H31: 

@IF(@VALUE(F31  )=@VALUE(G31  l.'l  ".-O") 

A;I31: 

34438.387719907 

A:J31: 

34438.387789352 

A:K31; 

@ABS(J31-I31)*86400 

A;B32: 

-HJ2&M2&N2 

A:E32: 

THL 

A:F32: 

A1 

A:G32: 

•1 

A;H32: 

@IF(@VALUE(F32)=@VALUE(G32).-1".-0'^ 

A:I32: 

34438.386354167 

A;J32: 

34438.386412037 

A:K32; 

@ABS(J32-I32r86400 

A:B33: 

•t-K2&M2&N2 

A:E33: 

TLH 

A;F33; 

A2 

A:G33; 

•2 

A:H33; 

@IF(@VALUE(F33)=@VALUE(G33).-r.-0-) 

A;I33: 

34438.387326389 

A:J33: 

34438.387395833 

A:K33: 

@ABS(J33-I33)*86400 

A:B34: 

+F3 

A:E34: 

TLL 

A:F34: 

A4 

A:G34: 

*4 

A:H34: 

@IF(@VALUE(F34)=@VALUE(G34),-r.-0-) 

A:I34: 

34438.388043981 

A:J34: 

34438.388090278 

A:K34: 

@ABS(J34-I34r86400 

A:A35: 

'Chai13 

A:B35: 

+G3 

A:E35: 

•B2HH 

A:F35; 

A3 

A:G35: 

•3 

A:H35: 

@IF(@VALUE(F35)=@VALUE{G35).-1”,-0’) 

A:I35: 

34438.387789352 

A:J35: 

34438.387847222 

A:K35: 

@ABS(J35-I35)*86400 

A:B36; 

+H3 

A:E36: 

'B2HL 

A:F36: 

A1 

A:G36: 

•1 

A:H36: 

@IF(@VALUE(F36)=@VALUE(G36),-r,-0’) 

A;I36: 

34438.387962963 

A:J36; 

34438.388043981 

A:K36: 

@ABS{J36-I36)*86400 

A;B37: 

+13 

A;E37: 

•B2LH 

A:F37: 

''2 
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A:G37: 

•2 

A:H37; 

@IF(@VALUE(F37)=@VALUE{G37)."r,*0*) 

A:I37- 

34438.386238426 

A:Ji7; 

34438.386354167 

A:K37: 

@ABS(J37-i37)*86400 

A:B38: 

+L3 

A:E38: 

’B2LL 

A:F38: 

A4 

A:G38: 

•4 

A:H38: 

@IF(@VALUE(F38)=@VALUE(G38).*r.’0*) 

A:I38: 

34438.386712963 

A:J38: 

34438.386770833 

A:K38; 

@ABS(J38-I38)*86400 

A:B39: 

-k)3&M3&N3 

A:D39: 

1 

A:E39: 

’B3HH 

A:F39: 

''I 

A:G39; 

•3 

A:H39: 

@IF(@VALUE{F39)=@VALUE(G39).*1-."0") 

A:I39; 

34438.388090278 

A:J39: 

34438.38818287 

A:K39: 

@ABS(J39-I39)'86400 

A;B40: 

+K3&M3&N3 

A:E40; 

•B3HL 

A;F40: 

M 

A;G40: 

'1 

A:H40: 

@IF(@VALUE(F40)=@VALUE(G40),’1  *  "O") 

A:I40: 

34438.388275463 

A:J40: 

34438.388402778 

A:K40: 

@ABS(J40-I40)*86400 

A:B41: 

+F4 

A:E41: 

•B3LH 

A:F41; 

A3 

A:G41; 

•2 

A;H41; 

@IF(@VALUE(F41  )=@VALUE(G41  ).*r  "O") 

A:I41: 

34438.3871875 

A:J41; 

34438.387256944 

A;K41: 

@ABS(J41-I4ir86400 

A:A42: 

'Chart4 

A:B42: 

+G4 

A:E42: 

'B3LL 

A:F42: 

-'2 

A:G42: 

■3 

A:H42: 

@IF(@VALUE(F42)=@VALUE(G42).’r.’0*) 

A:I42: 

34438.386840278 

A:J42: 

34438.386956019 

A:K42: 

@ABS(J42-I42)*86400 

A:B43: 

+H4 

A:E43: 

12HH 

A:F43: 

*1 

A:G43: 

3 

A:H43: 

@IF(@VALUE(F43)=@VALUE(G43),’r,'0") 

A:143: 

34438.38818287 

A:J43: 

34438.388275463 

A:K43: 

@ABS(J43-I43)*86400 

A:B44: 

+14 

A:E44: 

'L2HL 

A:F44: 

M 

A:G44: 

2 

A:H44: 

@IF(@VALUE(F44)=@VALUE(G44),’r."0") 

A:I44; 

34438.387523148 
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A:J44: 

34438.387604167 

A:K44; 

@ABS(J44-I44)*86400 

A:B45: 

+L4 

A:E45: 

■L2LH 

A:F45: 

*3 

A:G45: 

■2 

A:H45: 

@IF{@VALUE(F45)=@VALUE{G45).*1*.'0") 

A:I45: 

34438.387662037 

A:J45: 

34438.387719907 

A:K45: 

@ABS(J45-I45)*86400 

A:B46: 

4J4&M4&N4 

A:E46: 

•L2LL 

A:F46: 

A2 

A;G46: 

•4 

A;H46: 

@IF(@VALUE(F46)=@VALUE(G46).’r.*0*) 

A;I46: 

34438.386956019 

A;J46; 

34438.387083333 

A:K46: 

@ABS(J46-I46)*86400 

A;B47: 

-I-K4&M4&N4 

A:E47; 

•L3HH 

A:F47: 

A:G47; 

•3 

A:H47: 

@IF{@VALUE(F47)=@VALUE(G47),-r,’0’) 

A;I47: 

34438.386423611 

A:J47: 

34438.3865625 

A:K47: 

(§)ABS(J47-I47)*86400 

A:B48: 

+F5 

A:E48; 

•L3HL 

A:F48: 

''1 

A:G48; 

•3 

A;H48: 

@IF(@VALUE(F48)=@VALUE(G48),’r.'0*) 

A;I48; 

34438.3865625 

AuJ48: 

34438.386712963 

A:K48: 

@ABS(J48-I48)*86400 

A:A49: 

'Chart5 

A:B49: 

+G5 

A:E49: 

mH 

A:F49: 

^2 

A:G49; 

■2 

A;H49: 

@IF(@VALUE(F49)=@VALUE{G49),'1’.’0’) 

A:I49: 

34438.387858796 

A:J49: 

34438.387962963 

A:K49: 

@ABS(J49-I49)*86400 

A:B50: 

+H5 

A:E50: 

■L3LL 

A:F50; 

M 

A:G50: 

'2 

A;H50: 

@IF(@VALUE(F50)=@VALUE(G50),"r.’0') 

A:I50: 

34438.386770833 

A:J50: 

34438.386828704 

A:K50: 

@ABS(J50-t50)*86400 

A:B51: 

+I5 

A;E51: 

•MT 

A:F51: 

M 

A:G51: 

•4 

A:H51: 

@IF(@VALUE(F51  )=@VALUE(G51  ).’1  '.'O’) 

A:I51: 

34438.387395833 

A:J51: 

34438.387453704 

A:K51: 

@ABS(J51-I51)*86400 

A:B52 

+L5 

A:E52: 

'MB2 

A:F52: 

*2 

A:G52; 

•2 

A:H52: 

@IF((^VALUE(F52)=@VALUE{G52).*r.*0*) 

A:I52: 

34438  387604167 

A;J52: 

34438.387662037 

A:K52: 

@ABS(J52-I52)*86400 

A;B53: 

-KJ5&M5&N5 

A:E53: 

'MB3 

A:F53: 

-'I 

A:G53: 

'4 

A:H53: 

@IF(@VALUE(F53)=@VALUE(G53).“r.’0") 

A:I53: 

34438.387083333 

A:J53: 

34438.3871875 

A:K53: 

@ABS(J53-I53)*86400 

A:B54; 

-fK5&M5&N5 

A:E54: 

'ML2 

A;F54: 

A2 

A;G54; 

•2 

A:H54: 

@IF(@VALUE(F54)=@VALUE(G54),"1’,*0*) 

A:I54: 

34438.387256944 

A:J54: 

34438.387326389 

A:K54: 

@ABS(J54-I54)*86400 

A:BS5: 

+F6 

A;E55: 

'ML3 

A;F55: 

''3 

A:G55: 

■3 

A:H55; 

@IF(@VALUE(F55)=@VALUE{G55).*r,*0") 

A;I55; 

34438.387453704 

A:J55: 

34438.387523148 

A:K55: 

@ABS(J55-I55)*86400 

A:A56: 

'Charte 

A:B56: 

+G6 

A:I56; 

@MIN(I31..I55) 

A:J56: 

@MAX(I31..I55) 

A:K56: 

@ABS(J56-I56r86400 

A:L56: 

■l■K56/60 

A:B57: 

+H6 

A:E57: 

'Survey  Response 

A:B58: 

+16 

A:E58: 

AQ1 

A:F58: 

7 

A:B59: 

+L6 

A:E59: 

AQ2 

A:F59; 

7 

A:B60: 

+J6&M6&N6 

A:E60: 

AQ3 

A;F60: 

7 

A:B61: 

+K6&M6&N6 

A:E61: 

-^34 

A;F61: 

•3 

A:B62: 

+F7 

A:E62: 

AQ5 

A:F62: 

•2 

A:A63: 

•Chaft7 

A:B63: 

+G7 

A:E63: 

/<36 

A:F63: 

•4 

A:B64: 

+H7 

A:E64: 

-^7 

A:F64: 

•5 

A:B65: 

+17 
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A 

E65 

AQ8 

A 

F65 

■2 

A 

366 

+L7 

A 

E66 

'‘Q9 

A 

F66 

'8 

A 

B67 

-KJ7&M7&N7 

A 

E67 

''Q10 

A 

F67 

■4 

A 

B68 

+K7&M7&N7 

A 

E68 

\311 

A 

F68 

•7 

A 

B69 

+F8 

A 

E69 

AQ12 

A 

F69 

•2 

A 

A70 

'Chart8 

A 

B70 

+G8 

A 

E70 

''Q13 

A 

F70 

•1 

A 

B71 

+H8 

A 

E71 

AQ14 

A 

F71 

7 

A 

B72 

+18 

A 

E72 

A 

F72 

•8 

A 

B73 

+L8 

A 

E73 

X)16 

A 

F73 

•8 

A 

B74 

+J8&M8&N8 

A 

E74 

-^317 

A 

F74 

•9 

A 

B75 

+K8&M8&N8 

A 

•B76 

+F9 

A77 

’Chart9 

B77 

+G9 

:B78 

+H9 

A 

;B79 

+19 

A 

:B80 

+L9 

A 

:B81 

+J9&M9&N9 

A 

;B82 

+K9&M9&N9 

A 

:B83 

+F10 

A 

;A84 

‘ChartIO 

A 

:B84 

+G10 

A 

:B85 

+H10 

A 

:B86 

+110 

A 

:B87 

+L10 

A 

:B88 

+J10&M10&N10 

A 

:B89 

+K10&M10&N10 

A 

:B90 

+F11 

A 

:A91 

'Charti  1 

A 

:B91 

+G11 

A 

:B92 

+H11 

A 

:B93 

+111 

A 

:B94 

+L11 

A 

:B9S 

+J11&M11&N11 

A 

:B96 

+K11&M11&N11 

A 

;B97 

+F12 

A 

:A98 

'Charti  2 

A 

:B98 

+G12 

A 

:B9S 

+H12 

k:BlOO:  +112 

A 

:8l0t:  +L12 
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A 

3102: 

-KJ12&M12&N12 

A 

BIOS: 

+K12&M12&N12 

A 

3104: 

+F13 

A 

A105: 

'ChartlS 

A 

BIOS: 

+G13 

A 

B106: 

+H13 

A 

B107: 

+113 

A 

BIOS: 

+L13 

A 

B109: 

+J13&M13&N13 

A 

B110: 
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A:H224:  +H214/4 

A:I224:  +1214/4 

A:B225:  '{if  @@{'F63'')>’6"}{BEEP}{Message  Msg2.28.1 3,0}{Branch  Questions} 

A:E225:  ''SEP 

A:F225:  +F215/4 

A:G225:  +G215/4 

A:H225:  +H215/4 

A:I225:  +1215/4 

A;A226:  'Question7 
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A:B226:  ’{GRAPHyiEW  07} 

A:E226:  >007 

A:F226:  +F216/4 

A:G226:  +G216/4 

A;H226:  +H216/4 

4  A:I226:  +1216/4 

A:B227:  '{GRAPHCHAR  F64} 

A:E227;  ''NOV 
A:F227:  +F217/4 

A:G227:  +G217/4 

A:H227;  +H217/4 

A:I227:  +1217/4 

A:B228:  '{if  @@{"F64")="-"}{Branch  ShowMenu} 

A:E228;  ''DEC 
A:F228:  +F218/4 

A;G228;  +G218/4 

A:H228:  +H218/4 

A:I228;  +1218/4 

A:B229;  '{if  @<g)(*F64'')<''1  '^{BEEP}{Message  Msg2.28.13.0}{Branch  OuestionT} 
A:B230:  '{if  @@(*F64’)>'7^{BEEP}{Message  Msg2,28.1 3,0}{Bfanch  OuestionT} 

A:A231:  'Ouestion8 
A:B231 :  '{GRAPHVIEW  08} 

A:B232;  '{GRAPHCHAR  F65} 

A:B233;  '{if  @@CF65'')=''~'1{Branch  ShowMenu} 

A:B234:  '{if  @@(’F65”)<''1''}{BEEP}{Message  Msg2,28.13.0}{Branch  Ouestion8} 

A:B235:  '{if  @@(T65'0>''2*}{BEEP}{Message  Msg2.28.13,0}{Branch  Ouestion8} 

A:A236:  'Ouestiond 
A:B236:  '{GRAPHVIEW  09} 

A:B237:  ’{GRAPHCHAR  F66} 

A:B238:  '{if  @@("F66'')=*-''}{Branch  ShowMenu} 

A:B239:  '{if  @@(''F66'')<''n{BEEP}{Message  Msg2.28.13,0}{Branch  Ouestion9} 

A:B240:  '{if  @@rF66'')>''8'1{BEEP}{Message  Msg2,28,l  3,0}{Branch  Ouestion9} 

A:A241:  'OuestionlO 

A:B241 :  ’{GRAPHVIEW  01 0} 

A:B242:  '{GRAPHCHAR  F67} 

A:B243:  ’{if  @@(''F67")=’’~’1{Branch  ShowMenu} 

A:B244;  '{if  @@(''F671<’'n{BEEP}{Message  Msg2,28.13,0}{Branch  Ouestioni  0} 

A:B245:  ’{if  @@(1=671>’71{BEEP}{Message  Msg2.28,1 3,0}{Branch  Ouestioni  0} 

A:A246:  'Ouestioni  1 
A:B246:  '{GRAPHVIEW  011} 

A:B247:  '{GRAPHCHAR  F68} 

A:B248:  '{if  @@(T68'')=''~''}{Branch  ShowMenu} 

A:B249:  '{if  @@(*F68')<''n{BEEP}{Message  Msg2.28,13.0}{Branch  Ouestioni  1} 

A:B250:  '{if  @@(*F68’')>''8''}{BEEP}{Message  Msg2.28,1 3.0}{Branch  Ouestioni  1 } 

A:A251:  'Ouestioni  2 
A:B251 ;  ’{GRAPHVIEW  012} 

A:B252:  ’{GRAPHCHAR  F69} 

A:B253;  '{if  @@(*F69’’)=''~'1{Branch  ShowMenu} 

A:B254:  '{if  @@(''F69'')<''1  'l{BEEP}{Message  Msg2,28.1 3.0}{Branch  Ouestion  1 2} 

A:B255:  ’{if  @@(’T69'0>''2’i{BEEP}{Message  Msg2,28,1 3,0}{Branch  Ouestioni  2} 

A:A256;  'Ouestion13 
A:B256:  '{GRAPHVIEW  013} 

+  A:B257:  ’{GRAPHCHAR  F70} 

A:B258:  '{if  @@(T70'')='’~'^{Branch  ShowMenu} 

A;B259:  ’{if  @@(’F70’)<"1  ^{BEEP}{Message  Msg2,28,13.0}{Branch  Ouestion13} 
A:B260:  ’{if  @@('T70’1>''9’1{BEEP}{Message  Msg2,28,1 3,0}{Branch  Ouestion  1 3} 
A:A261;  'Ouestion  14 

^  A:B261:  ’{GRAPHVIEW  014} 

A:B262:  '{GRAPHCHAR  F71} 

A:B263:  '{if  @@CF71  ’’)=''~'^{Branch  ShowMenu} 

A:B264:  '{if  @@(’'F7n<’’1''}{BEEP}{Message  Msg2.28,13,0}{Branch  OuestionU} 
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A:B265 

A;A266 

A:B266 

A:B267 

A:B268 

A:B269 

A:B270 

A:A271 

A:B271 

A:B272 

A;B273 

A:B274 

A:B275 

A:A276 

A:B276 

A:B277 

A:B278 

A:B279 

A:B280 

A:A281 

A;B281 

A:A282 

A;B282 

A:B283 

A:A284 

A;B284 

A:B285 

A:B286 

A;B287 

A:B288 

A;B289 

A;B290 

A:B291 

A:B292 

A:B293 

A:B294 

A:B295 

A;B296 

A:B297 

A:C297 

A;B298 

A;C298 

A:B299 

A;C299 

A:B300 


A:C300: 

A;B301: 


A:C301: 

A:B302; 

A:C302: 

A;B303; 

A:B304: 


'{if  @@("F7r)>T'}{BEEP}{Message  Msg2,28,13,0}{Branch  QuestionM} 

'Question  15 
'{GRAPHVIEWQ15} 

'{GRAPHCHAR  F72} 

'{if  @@("F72'')=''~'7{Branch  ShowMenu) 

'{if  @@(''F72'')<''r}{BEEP}{Message  Msg2.28,13,0}{Branch  QuestionIS} 

'{if  @@(“F72'')>''8''}{BEEP}{Message  Msg2,28,13,0}{Branch  QuestionIS} 

'Question  16 
•{GRAPHVIEWQ16} 

'{GRAPHCHAR  F73} 

'{if  @@(T73'')=''~’'}{Branch  ShowMenu} 

'{if  @@(“F73'')<''1''}{BEEP}{Message  Msg2.28,13,0}{Branch  QuestionIS} 

'{if  @@(''F73'')>"8''}{BEEP}{Message  Msg2.28.13,0}{Branch  QuestionIS} 

'Question  17 
'{GRAPHVIEWQ17} 

'{GRAPHCHAR  F74} 

'{if  @@(*F74'')='’-''}{Branch  ShowMenu} 

'{if  @@(T74'')<''1''}{BEEP}{Message  Msg2,28.13.0}{Branch  QuestionIT} 

'{if  @@(T74'')>''8''}{BEEP}{Message  Msg2,28.13.0}{Branch  QuestionIT} 

TheEnd 

'{GRAPHVIEW  THE_END} 

'{GRAPHCHAR  A282} 

•{if  @@(-A282-)<>''~'7{Branch  TheEnd} 

'ShowMenu 

'{deletennenu  /Processing ...} 

'{Bieakon} 

'{APPL1CATION.DISPLAY  ''none,yes,yes,yes,a..b;a1  ..b2'^ 

'{setobjectproperty  '■/File.hidden'',''no''} 

'{setobjectproperty  ■/EDIT.hidden*.''no''} 

'{setobjectproperty ’/BLOCK.hidden", ’no*} 

'{setobjectproperty  */DATA.hidden", ’no’} 

'{setobjectproperty  ’/TOOLS.hidden’.’no*} 

'{setobjectproperty  ’/GRAPH.hidden’.’no'^ 

'{setobjectproperty  ’/PROPERTY,  hidden’, ’no*} 

'{setobjec^roperty  ’/WINCXDW.hidden’.’no’} 

'{setobjectproperty  ’/HELP.hidden’.’no'^ 

'{WINDOWshow  thesis,  wbl} 

■0 

'{OPEN  ’A:\S1_ 

•{CALC} 

@INT(@NOW-34334) 

+C297&@STRING(C298,0)&C299 

•.txt’.w} 

’{Writeln"Cor_Ans,’,rh31.'.’,+h32,",’.+h33,',".+h34,’.’,+h35,",’,+h36.’.’.+h37,".’,+h38,’,',+h38, 

’,’,+h39,’,’,+h40.",",+h41,",",+h42,’.".+h43,",’,+h44.’.’.+h45,’,’,+h46,’,’,+h47,’.".+h48.".’.+h49.’ 

.’,+h50} 

'{writein  "Time,’.@string(k31,0),’,",@string(k32.0).’.’,@string(k33,0),",’,@string(k34,0).".’,@str 

ing(k35,0),’,’,@string(k36,0),",’.@string{k37,0),’,’,@string(k38,0),’,’,@string(k39,0),'.',@strin 

g(k40.0),’.’.@string(k41,0),",’,@string(k42.0),",",@string(k43.0),',’.@string(k44,0),’,",@string( 

k45.0),’,",@string(k46,0),’.’.@string(k47,0),’.".@string(k48,0).’.".@string(k49.0).",".@string(k5 

p.O)} 


•{Writein ’Survey, ".+f58,’.’,+f59,",’,+f60,' 
,’,’,+f68,".’.+f69,".’,+f70,’,",+f71,".’,+f72, 


,+f61,".’,+f62,",",+f63,’.’,+f64,’,",+f65,",’,+f66,' 

',+f73,’,’,+f74} 


,+f67 


'{Close} 

'{Quit} 


(k 


IP 
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Appendix  D.  Raw  Data 


This  appendix  contains  the  recorded  performance  for  each  question  as  accomplished 
by  the  individual  subjects  who  participated  in  the  experiment.  Table  28  contains  the 
accuracy  scores  that  each  individual  received  by  mode  of  presentation  and  task  anchoring 
level.  Table  29  contains  the  response  time  scores  that  each  individual  received  by  mode 
of  presentation  and  task  anchoring  level.  Finally,  Table  30  contains  each  individual's 
response  to  the  end-of-exercise  questionnaire.  The  questions  asked  during  the  end-of- 
exercise  questionnaire  are  located  in  Appendix  B. 


Table  28.  Accuracy  Scores. 


Table  28.  Accuracy  Scores  (continued). 


MODE> 

Table 

Table 

Table 

Table 

2D-Bar 

2D-Bar 

2D-Bar 

TASK> 

HH 

HL 

LH 

Li 

HH 

HL 

LH 

Subj.  33 

1 

1 

1 

1 

1 

1 

1 

Subj.  34 


Subj.  35 


Subj.  36 


Subj.  37 


Subj.  38 


Subj.  39 


Subj.  40 


Subj.  41 


Subj.  42 


Subj.  43 


Subj.  44 


Subj.  45 


Subj.  46 


Subj.  47 


Subj.  48 


Subj.  49 


Subj.  50 


Subj.  51 


Subj.  52 


Subj.  53 


Subj.  54 


Subj.  55 


Subj.  56 


Subj.  57 


Subj.  58 


Subj.  59 


Subj.  60 


Subj.  61 


Subj.  62 


Subj.  63 


Subj.  64 


1 

1 

1 

1 
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Table  28.  Accuracy  Scores  (continued). 


MODE> 


TASK> 


Subj.  1 


Subj.  2 


Subj.  3 


Subj.  4 


Subj.  5 


Subj.  6 


Subj.  7 


Subj.  8 


Subj.  9 


Subj.  10 


Subj.  1 1 


Subj.  12 


Subj.  13 


Subj.  14 


Subj.  15 


Subj.  16 


Subj.  17 


Subj.  18 


Subj.  19 


Subj.  20 


Subj.  21 


Subj.  22 


Subj.  23 


Subj.  24 


Subj.  25 


Subj.  26 


Subj.  27 


Subj.  28 


Subj.  29 


Subj.  30 


Subj.  31 


Subj.  32 


2D-Bar  3D-Bar  3D-Bar  3D-Bar  3D-Bar  2D-IJne  2D-Line 


1 

1 

1 

1 
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Table  28.  Accuracy  Scores  (continued). 
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MODE> 

2D-Line 

2D-Line 

3D-Line 

3D-ljne 

3D-Line 

3D-Une 

TASK> 

LH 

II 

HH 

HL 

LH 

LL 

Subj.  1 

1 

1 

0 

1 

1 

1 

Subj.2 

1 

1 

1 

1 

1 

1 

Subj.  3 

1 

1 

0 

1 

1 

0 

Subj.  4 

1 

1 

0 

1 

1 

1 

Subj.  5 

1 

1 

0 

1 

1 

1 

Subj.  6 

1 

1 

0 

1 

1 

0 

Subj.  7 

1 

1 

0 

1 

1 

0 

Subj.  8 

1 

1 

0 

1 

1 

0 

Subj.  9 

1 

1 

0 

1 

1 

1 

Subj.  10 

1 

0 

0 

1 

1 

0 

Subj.  1 1 

1 

1 

0 

1 

1 

0 

Subj.  12 

1 

1 

0 

1 

1 

0 

Subj.  13 

1 

1 

1 

1 

1 

1 

Subj.  14 

1 

1 

0 

1 

1 

1 

Subj.  15 

1 

1 

0 

1 

1 

1 

Subj.  16 

1 

1 

0 

1 

1 

0 

Subj.  17 

1 

1 

0 

1 

1 

1 

Subj.  18 

1 

1 

0 

1 

0 

1 

Subj.  19 

1 

1 

0 

1 

1 

0 

Subj.  20 

1 

1 

0 

1 

1 

0 

Subj.  21 

1 

1 

0 

1 

1 

1 

Subj.  22 

1 

1 

0 

1 

1 

1 

Subj.  23 

1 

1 

0 

1 

1 

0 

Subj.  24 

1 

0 

0 

1 

1 

0 

Subj.  25 

1 

1 

0 

1 

1 

1 

Subj.  26 

1 

1 

0 

1 

1 

1 

Subj.  27 

1 

1 

0 

1 

1 

1 

Subj.  28 

1 

1 

0 

1 

1 

1 

Subj.  29 

1 

0 

0 

1 

1 

1 

Subj.  30 

1 

1 

0 

1 

1 

0 

Subj.  31 

1 

0 

0 

1 

1 

0 

Subj.  32 

0 

0 

0 

1 

1 

0 

o  o 


Table  28.  Accuracy  Scores  (continued). 


MODE> 
TASK> 
Subj.  33 
Subj.  34 
Subj.  35 
Subj.  36 
Subj.  37 
Subj.  38 
Subj.  39 
Subj.  40 
Subj.  41 
Subj.  42 
Subj.  43 
Subj.  44 
Subj.  45 
Subj.  46 
Subj.  47 
Subj.  48 
Subj.  49 
Subj.  50 
Subj.  51 
Subj.  52 
Subj.  53 
Subj.  54 
Subj.  55 
Subj.  56 
Subj.  57 
Subj.  58 
Subj.  59 
Subj.  60 
Subj.  61 
Subj.  62 
Subj.  63 
Subj.  64 


Table  29.  Response  Time. 


MODE> 

Table 

Table 

Table 

Table 

2D-Bar 

2D-Bar 

2D- Bar 

TASK> 

HH 

HL 

LH 

LL 

HH 

HL 

LH 

Subj.  1 

57.0 

22.0 

32.0 

63.0 

28.0 

12.0 

12.0 

Subj.  2 

15.0 

31.0 

24.0 

52.0 

20.0 

19.0 

11.0 

Subj.  3 

10.0 

12.0 

14.0 

27.0 

10.0 

11.0 

8.0 

Subj.  4 

10.0 

20.0 

9.0 

19.0 

38.0 

9.0 

12.0 

Subj.  5 

13.0 

13.0 

21.0 

1  37.0 

19.0 

15.0 

17.0 

Subj.  6 

13.0 

16.0 

14.0 

28.0 

21.0 

12.0 

16.0 

Subj.  7 

21.0 

23.0 

43.0 

64.0 

41.0 

35.0 

23.0 

Subj.  8 

9.0 

25.0 

45.0 

62.0 

23.0 

17.0 

14.0 

Subj.  9 

29.0 

25.0 

21.0 

106.0 

53.0 

23.0 

17.0 

Subj.  10 

13.0 

9.0 

17.0 

29.0 

13.0 

12.0 

29.0 

Subj.  1 1 

14.0 

13.0 

34.0 

94.0 

15.0 

33.0 

15.0 

Subj.  12 

15.0 

12.0 

11.0 

46.0 

15.0 

12.0 

15.0 

Subj.  13 

41.0 

15.0 

28.0 

50.0 

27.0 

17.0 

13.0 

Subj.  14 

17.0 

29.0 

17.0 

36.0 

16.0 

18.0 

37.0 

Subj.  15 

23.0 

21.0 

28.0 

78.0 

14.0 

40.0 

41.0 

Subj.  16 

25.0 

17.0 

33.0 

48.0 

14.0 

16.0 

21.0 

Subj.  17 

17.0 

35.0 

26.0 

57.0 

18.0 

29.0 

17.0 

Subj.  18 

9.0 

11.0 

11.0 

39.0 

9.0 

9.0 

17.0 

Subj.  19 

19.0 

23.0 

43.0 

185.0 

15.0 

21.0 

23.0 

Subj.  20 

16.0 

25.0 

52.0 

74.0 

19.0 

27.0 

17.0 

Subj.  21 

20.0 

16.0 

20.0 

64.0 

16.0 

29.0 

13.0 

Subj.  22 

10.0 

13.0 

17.0 

21.0 

10.0 

15.0 

9.0 

Subj.  23 

10.0 

18.0 

27.0 

65.0 

22.0 

16.0 

26.0 

Subj.  24 

36.0 

25.0 

19.0  1 

59.0 

13.0 

21.0 

13.0 

Subj.  25 

18.0 

18.0 

39.0 

54.0 

12.0 

18.0 

13.0 

Subj.  26 

13.0 

20.0 

14.0 

51.0 

15.0 

17.0 

17.0 

Subj.  27 

40.0 

18.0 

18.0 

34.0 

18.0 

20.0 

12.0 

Subj.  28 

12.0 

16.0 

13.0 

68.0 

13.0 

14.0 

18.0 

Subj.  29 

13.0 

17.0 

12.0 

33.0 

15.0 

12.0 

13.0 

Subj.  30 

16.0 

24.0 

15.0 

35.0 

24.0 

11.0 

14.0 

Subj.  31 

22.0 

17.0 

22.0 

64.0 

27.0 

18.0 

27.0 

Subj.  32 

19.0 

19.0 

41.0 

36.0 

13.0 

18.0 

18.0 
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Table  29.  Response  Time  (continued). 


MODE> 

Table 

Table 

Table 

Table 

2D-Bar 

2D-Bar 

2D-Bar 

TASK> 

HH 

HL 

LH 

11 

HH 

HL 

LH 

Subj.  33 

11.0 

23.0 

16.0 

67.0 

18.0 

11.0 

11.0 

Subj.  34 

16.0 

13.0 

12.0 

46.0 

11.0 

10.0 

15.0 

Subj.  35 

20.0 

23.0 

25.0 

16.0 

13.0 

33.0 

23.0 

Subj.  36 

17.0 

20.0 

25.0 

27.0 

12.0 

31.0 

8.0 

Subj.  37 

10.0 

19.0 

25.0 

70.0 

16.0 

28.0 

39.0 

Subj.  38 

27.0 

13.0 

11.0 

54.0 

16.0 

24.0 

14.0 

Subj.  39 

24.0 

14.0 

43.0 

50.0 

23.0 

20.0 

17.0 

Subj.  40 

11.0 

14.0 

9.0 

38.0 

11.0 

15.0 

34.0 

Subj.  41 

12.0 

9.0 

16.0 

17.0 

14.0 

9.0 

12.0 

Subj.  42 

17.0 

16.0 

14.0 

64.0 

11.0 

11.0 

10.0 

Subj.  43 

14.0 

17.0 

11.0 

35.0 

11.0 

12.0 

14.0 

Subj.  44 

15.0 

23.0 

47.0 

33.0 

10.0 

19.0 

29.0 

Subj.  45 

11.0 

32.0 

15.0 

35.0 

14.0 

15.0 

20.0 

Subj.  46 

11.0 

20.0 

28.0 

68.0 

12.0 

16.0 

27.0 

Subj.  47 

14.0 

16.0 

13.0 

43.0 

30.0 

20.0 

22.0 

Subj.  48 

10.0 

12.0 

11.0 

29.0 

10.0 

10.0 

8.0 

Subj.  49 

12.0 

18.0 

11.0 

63.0 

22.0 

15.0 

17.0 

Subj.  50 

21.0 

16.0 

46.0 

26.0 

12.0 

23.0 

18.0 

Subj.  51 

34.0 

16.0 

18.0 

62.0 

19.0 

25.0 

25.0 

Subj.  52 

11.0 

14.0 

21.0 

95.0 

45.0 

16.0 

10.0 

Subj.  53 

27.0 

14.0 

12.0 

44.0 

17.0 

33.0 

21.0 

Subj.  54 

19.0 

16.0 

21.0 

44,0 

65.0 

28.0 

11.0 

Subj.  55 

39.0 

15.0 

29.0 

57.0 

19.0 

16.0 

20.0 

Subj.  56 

11.0 

21.0 

13.0 

60.0 

18.0 

38.0 

24.0 

Subj.  57 

29.0 

19.0 

70.0 

26.0 

21.0 

21.0 

20.0 

Subj.  58 

15.0 

13.0 

11.0 

34.0 

12,0 

25.0 

14.0 

Subj.  59 

15.0 

13.0 

17.0 

21.0 

11.0 

19.0 

19.0 

Subj.  60 

27.0 

27.0 

30.0 

146.0 

14.0 

17.0 

29.0 

Subj.  61 

10.0 

15.0 

11.0 

36.0 

11.0 

16.0 

26.0 

Subj.  62 

21.0 

18.0 

25.0 

82.0 

23.0 

26.0 

19.0 

Subj.  63 

15.0 

18.0 

16.0 

44.0 

18.0 

15.0 

17.0 

Subj.  64 

16.0 

25.0 

19.0 

46.0 

11.0 

21.0 

24.0 
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Table  29.  Response  Time  (continued). 


MODE> 

2D-Bar 

3D-Bar 

3D-Bar 

3D-Bar 

3D-Bar 

2D-Line 

2D-Line 

TASK> 

LL 

HH 

HL 

LH 

11 

HH 

HL 

Subj.  1 

25.0 

15.0 

13.0 

9.0 

40.0 

25.0 

26.0 

Subj.  2 

35.0 

16.0 

24.0 

18.0 

95.0 

15.0 

36.0 

Subj.  3 

22.0 

13.0 

56.0 

12.0 

24.0 

11.0 

14.0 

Subj.  4 

26.0 

12.0 

15.0 

8.0 

21.0 

10.0 

14.0 

Subj.  5 

31.0 

18.0 

57.0 

13.0 

26.0 

16.0 

12.0 

Subj.  6 

30.0 

39.0 

15.0 

18.0 

38.0 

21.0 

17.0 

Subj.  7 

28.0 

16.0 

46.0 

24.0 

97.0 

20.0 

29.0 

Subj.  8 

85.0 

17.0 

14.0 

20.0 

64.0 

15.0 

18.0 

Subj.  9 

102.0 

18.0 

20.0 

28.0 

83.0 

22.0 

14.0 

Subj.  10 

25.0 

10.0 

15.0 

8.0 

15.0 

13.0 

16.0 

Subj.  1 1 

45.0 

13.0 

25.0 

15.0 

42.0 

8.0 

14.0 

Subj.  12 

24.0 

13.0 

16.0 

19.0 

47.0 

14.0 

31.0 

Subj.  13 

51.0 

17.0 

20.0 

20.0 

28.0 

20.0 

18.0 

Subj.  14 

37.0 

19.0 

23.0 

26.0 

97.0 

26.0 

14.0 

Subj.  15 

80.0 

16.0 

26.0 

28.0 

31.0 

30.0 

28.0 

Subj.  16 

18.0 

15.0 

23.0 

30.0 

65.0 

15.0 

28.0 

Subj.  17 

74.0 

13.0 

22.0 

25.0 

216.0 

87.0 

34.0 

Subj.  18 

34.0 

13.0 

15.0 

9.0 

23.0 

9.0 

12.0 

Subj.  19 

56.0 

38.0 

94.0 

28.0 

31.0 

18.0 

21.0 

Subj.  20 

43.0 

22.0 

26.0 

22.0 

33.0 

39.0 

19.0 

Subj.  21 

29.0 

28.0 

27.0 

14.0 

63.0 

12.0 

13.0 

Subj.  22 

39.0 

17.0 

19.0 

12.0 

63.0 

12.0 

16.0 

Subj.  23 

39.0 

21.0 

18.0 

11.0 

63.0 

17.0 

20.0 

Subj.  24 

10.0 

20.0 

33.0 

23.0 

85.0 

16.0 

19.0 

Subj.  25 

30.0 

20.0 

24.0 

18.0 

46.0 

11.0 

11.0 

Subj.  26 

49.0 

21.0 

23.0 

17.0 

31.0 

16.0 

17.0 

Subj.  27 

47.0 

19.0 

22.0 

28.0 

52.0 

12.0 

18.0 

Subj.  28 

14.0 

36.0 

23.0 

15.0 

27.0 

14.0 

14.0 

Subj.  29 

24.0 

30.0 

18.0 

13.0 

38.0 

22.0 

12.0 

Subj.  30 

20.0 

15.0 

14.0 

9.0 

28.0 

11.0 

20.0 

Subj.  31 

62.0 

29.0 

22.0 

36.0 

63.0 

22.0 

21.0 

Subj.  32 

18.0 

32.0  , 

18.0 

26.0 

18.0 

20.0 

14.0 
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Table  29.  Response  Time  (continued). 


MODE> 

2D-Bar 

3D~Bor 

3D-Bar 

3D-Bar 

3D-Bar 

'  2D-Ljne 

2D-Une 

TASK> 

II 

HH 

HL 

LH 

LL 

HH 

HL 

Subj.  33 

28.0 

16.0 

28.0 

16.0 

43.0 

9.0 

13.0 

Subj.  34 

24.0 

20.0 

13.0 

15.0 

27.0 

14.0 

14.0 

Subj.  35 

44.0 

12.0 

23.0 

13.0 

41.0 

24.0 

33.0 

Subj.  36 

23.0 

40.0 

13.0 

19.0 

15.0 

12.0 

37.0 

Subj.  37 

28.0 

19.0 

63.0 

54.0 

44.0 

38.0 

19.0 

Subj.  38 

42.0 

11.0 

21.0 

11.0 

40.0 

43.0 

18.0 

Subj.  39 

58.0 

10.0 

33.0 

32.0 

48.0 

26.0 

9.0 

Subj.  40 

46.0 

19.0 

12.0 

18.0 

43.0 

16.0 

17.0 

Subj.  41 

40.0 

9.0 

14.0 

20.0 

27.0 

11.0 

10.0 

Subj.  42 

42.0 

16.0 

14.0 

13.0 

39.0 

14.0 

21.0 

Subj.  43 

16.0 

10.0 

22.0 

10.0 

29.0 

15.0 

14.0 

Subj.  44 

35.0 

14.0 

30.0 

15.0 

55.0 

14.0 

29.0 

Subj.  45 

29.0 

25.0 

27.0 

15.0 

35.0 

13.0 

22.0 

Subj.  46 

80.0 

49.0 

14.0 

17.0 

54.0 

10.0 

46.0 

Subj.  47 

66.0 

23.0 

17.0 

26.0 

58.0 

17.0 

24.0 

Subj.  48 

29.0 

15.0 

17.0 

12.0 

21.0 

12.0 

12.0 

Subj.  49 

48.0 

28.0 

22.0 

20.0 

35.0 

8.0 

45.0 

Subj.  50 

70.0 

15.0 

36.0 

17.0 

34.0 

11.0 

14.0 

Subj.  51 

93.0 

9.0 

12.0 

20.0 

52.0 

14.0 

17.0 

Subj.  52 

74.0 

14.0 

24.0 

17.0 

36.0 

42.0 

17.0 

Subj.  53 

43.0 

15.0 

17.0 

19.0 

37.0 

27.0 

18.0 

Subj.  54 

65.0 

58.0 

14.0 

24.0 

37.0 

12.0 

31.0 

Subj.  55 

39.0 

14.0 

26.0 

13.0 

55.0 

16.0 

13.0 

Subj.  56 

66.0 

19.0 

16.0 

11.0 

31.0 

16.0 

29.0 

Subj.  57 

73.0 

22.0 

13.0 

16.0 

37.0 

29.0 

20.0 

Subj.  58 

26.0 

13.0 

12.0 

16.0 

20.0 

8.0 

12.0 

Subj.  59 

17.0 

17.0 

13.0 

22.0 

31.0 

21.0 

16.0 

Subj.  60 

48.0 

18.0 

51.0 

22.0 

72.0 

24.0 

13.0 

Subj.  61 

21.0 

25.0 

13.0 

23.0 

36.0 

19.0 

25.0 

Subj.  62 

67.0 

20.0 

42.0 

25.0 

50.0 

21.0 

15.0 

Subj.  63 

51.0 

18.0 

21.0 

19.0 

34.0 

23.0 

36.0 

Subj.  64 

51.0 

14.0 

28.0 

17.0 

75.0 

18.0 

26.0 
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Table  29.  Response  Time  (continued). 


MODE> 

2D-lJne 

2D-Ljne 

3D-Line 

3D-Line 

3D-Une 

3D-lJne 

TASK> 

LH 

LL 

HH 

HL 

LH 

11 

Subj.  1 

10.0 

13.0 

33.0 

17.0 

34.0 

36.0 

Subj.  2 

14,0 

41.0 

16.0 

17.0 

28.0 

56.0 

Subj.  3 

10.0 

23.0 

28.0 

11.0 

15.0 

22.0 

Subj.  4 

15.0 

16.0 

11.0 

11.0 

11.0 

28.0 

Subj.  5 

12.0 

17.0 

25.0 

15.0 

52.0 

17.0 

Subj.  6 

13.0 

34.0 

33.0 

19.0 

8.0 

35.0 

Subj.  7 

35.0 

43.0 

13.0 

29.0 

15.0 

34.0 

Subj.  8 

9.0 

36.0 

30.0 

37.0 

21.0 

56.0 

Subj.  9 

12.0 

35.0 

26.0 

15.0 

24.0 

42.0 

Subj.  10 

12.0 

23.0 

14.0 

15.0 

17.0 

10.0 

Subj.  11 

15.0 

59.0 

18.0 

12.0 

16.0 

57.0 

Subj.  12 

12.0 

18.0 

30.0 

20.0 

18.0 

46.0 

Subj.  13 

20.0 

33.0 

33.0 

12.0 

85.0 

11.0 

Subj.  14 

17.0 

26.0 

39.0 

12.0 

19.0 

41.0 

Subj.  15 

17.0 

51.0 

36.0 

16.0 

56.0 

65.0 

Subj.  16 

9.0 

40.0 

47.0 

16.0 

19.0 

25.0 

Subj.  17 

15.0 

44.0 

36.0 

13.0 

56.0 

12.0 

Subj.  18 

11.0 

23.0 

19.0 

15.0 

26.0 

19.0 

Subj.  19 

17.0 

148.0 

43.0 

26.0 

39.0 

47.0 

Subj.  20 

15.0 

15.0 

36.0 

28.0 

25.0 

27.0 

Subj.  21 

15.0 

20.0 

21.0 

16.0 

23.0 

14.0 

Subj.  22 

12.0 

26.0 

20.0 

10.0 

16.0 

11.0 

Subj.  23 

14.0 

28.0 

37.0 

13.0 

14.0 

33.0 

Subj.  24 

14.0 

27.0 

14.0 

30.0 

21.0 

19.0 

Subj.  25 

37.0 

21.0 

34.0 

16.0 

13.0 

22.0 

Subj.  26 

11.0 

28.0 

26.0 

20.0 

26.0 

20.0 

Subj.  27 

14.0 

49.0 

43.0 

14.0 

16.0 

41.0 

Subj.  28 

12.0 

44.0 

31.0 

15.0 

14.0 

32.0 

Subj.  29 

11.0 

28.0 

25.0 

15.0 

23.0 

20.0 

Subj.  30 

11.0 

14.0 

15.0 

12.0 

36.0 

13.0 

Subj.  31 

25.0 

54.0 

29.0 

15.0 

17.0 

28.0 

Subj.  32 

14.0 

34.0 

26.0 

13.0 

21.0 

20.0 
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Table  29.  Response  Time  (continued). 


MODE> 

2D-Line 

2D-Line 

3D-Line 

3D-Une 

3D-Line 

3D-Line 

TASK> 

LH 

11 

HH 

HL 

LH 

II 

Subj.  33 

13.0 

24.0 

34.0 

15.0 

15.0 

25.0 

Subj.34 

23.0 

39.0 

i  32.0 

18.0 

34.0 

22.0 

Subj.  35 

13.0 

19.0 

16.0 

13.0 

17.0 

40.0 

Subj.  36 

97.0 

18.0 

22.0 

10.0 

25.0 

32.0 

Subj.  37 

38.0 

39.0 

18.0 

21.0 

18.0 

61.0 

Subj.  38 

48.0 

26.0 

39.0 

12.0 

23.0 

16.0 

Subj.  39 

11.0 

47.0 

32.0 

10.0 

30.0 

34.0 

Subj.  40 

32.0 

40.0 

23.0 

23.0 

25.0 

32.0 

Subj.  41 

10.0 

36.0 

17.0 

12.0 

11.0 

16.0 

Subj.  42 

7.0 

17.0 

16.0 

10.0 

20.0 

19.0 

Subj.  43 

16.0 

25.0 

26.0 

12.0 

15.0 

16.0 

Subj.  44 

14.0 

61.0 

23.0 

32.0 

16.0 

71.0 

Subj.  45 

19.0 

42.0 

23.0 

15.0 

24.0 

21.0 

Subj.  46 

16.0 

75.0 

47.0 

18.0 

27.0 

64.0 

Subj.  47 

34.0 

38.0 

40.0 

34.0 

14.0 

70.0 

Subj.  48 

13.0 

26.0 

20.0 

10.0 

10.0 

18.0 

Subj.  49 

15.0 

24.0 

23.0 

21.0 

26.0 

23.0 

Subj.  50 

14.0 

36.0 

21.0 

15.0 

26.0 

15.0 

Subj.  51 

30.0 

31.0 

31.0 

10.0 

22.0 

23.0 

Subj.  52 

28.0 

59.0 

14.0 

15.0 

21.0 

136.0 

Subj.  53 

35.0 

28.0 

72.0 

17.0 

15.0 

44.0 

Subj.  54 

15.0 

72.0 

29.0 

13.0 

23.0 

47.0 

Subj.  55 

18.0 

25.0 

35.0 

16.0 

14.0 

27.0 

Subj.  56 

17.0 

62.0 

27.0 

11.0 

22.0 

47.0 

Subj.  57 

29.0 

23.0 

17.0 

23.0 

13.0 

37.0 

Subj.  58 

14.0 

23.0 

18.0 

11.0 

17.0 

38.0 

Subj.  59 

38.0 

21.0 

25.0 

12.0 

11.0 

22.0 

Subj.  60 

57.0 

29.0 

48.0 

37.0 

14.0 

20.0 

Subj.  61 

10.0 

23.0 

34.0 

14.0 

13.0 

31.0 

Subj.  62 

34.0 

38.0 

28.0 

19.0 

17.0 

53.0 

Subj.  63 

27.0 

43.0 

29.0 

22.0 

23.0 

38.0 

Subj.  64 

82.0 

49.0 

17.0 

17.0 

14.0 

20.0 
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Question>  Q 1 


Subj.  1 


Subj.  2 


Subj.  3 


Subj.  4 


Subj.  5 


Subj.  6 


Subj.  7 


Subj.  8 


Subj.  9 


Subj.  10 


Subj.  1 1 


Subj.  12 


Subj.  13 


Subj.  14 


Subj.  15 


Subj.  16 


Subj.  17 


Subj.  18 


Subj.  19 


Subj.  20 


Subj.  21 


Subj.  22 


Subj.  23 


Subj.  24 


Subj.  25 


Subj.  26 


Subj.  27 


Subj.  28 


Subj.  29 


Subj.  30 


Subj.  31 


Subj.  32 


Q2  Q3  Q4 


Table  30.  Questionnaire  Responses  (continued). 
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Table  30.  Questionnaire  Responses  (continued). 


Subj.  30 

6 

3 

1 

2 

5 

6 

5 

8 

Subj.  31 

5 

6 

1 

2 

4 

5 

5 

8 

Subj.  32 

7 

6 

1 

3 

4 

6 

8 

8 
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Table  30.  Questionnaire  Responses  (continued). 


Q10  Q11  Q12  Q13  Q14  Q 15  Q 16  Q 17 


Subj.  33 


Subj.  34 


Subj.  35 


Subj.  36 


Subj.  37 


Subj.  38 


Subj.  39 


Subj.  40 


Subj.  41 


Subj.  42 


Subj.  43 


Subj.  44 


Subj.  45 


Subj.  46 


Subj.  47 


Subj.  48 


Subj.  49 


Subj.  50 


Subj.  51 


Subj.  52 


Subj.  53 


Subj.  54 


Subj.  55 


Subj.  56 


Subj.  57 


Subj.  58 


Subj.  59 


Subj.  60 


Subj.  61 


Subj.  62 


Subj.  63 


Subj.  64 


Appendix  E.  LN  Transformation  of  Response  Times 


This  appendix  contains  the  LN  transformation  of  response  time  score  that  each 
individual  received  by  mode  of  presentation  and  task  anchoring  level.  In  addition,  it  also 
contains  the  demographic  categories  for  gender,  rank,  educational  level,  and  training 
level,  that  each  individual  was  determined  to  be  in  based  on  their  responses  to  the  end-of- 
exercise  questions.  The  data  in  this  appendix  was  used  to  perform  the  Multifactor 
Analysis  of  Variance  with  Repeated  Measure  calculations  provided  in  Appendix  G. 


V 


f 
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Table  31 .  LN  Transformation  of  Resporwe  Time  for  Stotisticai  Anaiyses. 


Subject  Data  Gender  Rank 


SubJ.  1 


Subj.  2 


Subj.  3 


Subj.  4 


Subj.  5 


Subj.  6 


Subj.  7 


Subj.  8 


Subj.  9 


Subj.  10 


Subj.  1 1 


Subj.  12 


Subj.  13 


Subj.  14 


Subj.  15 


Subj.  16 


Subj.  17 


Subj.  18 


Subj.  19 


Subj.  20 


Subj.  21 


Subj.  22 


Subj.  23 


Educ. 

Mode> 

Toslo 

Train. 

2 

1 

1 

1 

2 

2 

2 

2 

2 

3 

2 

1 

Subj.  24 


Subj.  25 


Subj.  26 


Subj.  27 


Subj.  28 


Subj.  29 


Subj.  30 


Subj.  31 


Table  31 .  LN  Transformation  of  Resporise  Time  for  Statistical  Analyses  (continued). 


Subject 

Data 

Gender 

Rank 

Educ. 

Mode> 

Table 

Table 

Table 

Table 

Toslo 

HH 

1 

HL 

LH 

LL 

Train. 

Subj.  32 

2 

1 

1 

1 

3 

2.8 

2.6 

2.5 

3.8 

2 

2 

2 

2 

2 

3.0 

3.1 

3.2 

2.8 

Subj.  34 

2 

2 

1 

1 

1 

2.8 

3.0 

3.2 

3.3 

Subj.  35 

2 

2 

1 

1 

3 

2.3 

2.9 

3.2 

4.2 

Subj.  36 

2 

1 

1 

1 

3 

3.3 

2.6 

2.4 

4.0 

Subj.  37 

2 

1 

1 

1 

3 

3.2 

2.6 

3.8 

3.9 

Subj.  38 

2 

2 

1 

1 

1 

2.4 

2.6 

2.2 

3.6 

Subj.  39 

2 

1 

1 

2 

1 

2.5 

2.2 

2.8 

2.8 

Subj.  40 

2 

1 

1 

2 

1 

2.8 

2.8 

2.6 

CM 

Subj.  41 

2 

1 

2 

2 

1 

2.6 

2.8 

2.4 

3.6 

Subj.  42 

2 

1 

1 

2 

3 

2.7 

3.1 

3.9 

3.5 

Subj.  43 

2 

2 

1 

1 

1 

2.4 

3.5 

2.7 

3.6 

Subj.  44 

2 

2 

1 

1 

3 

2.4 

3.0 

3.3 

4.2 

Subj.  45 

2 

1 

2 

2 

1 

2.6 

2.8 

■9S 

3.8 

2 

1 

2 

2 

3 

2.3 

2.5 

2.4 

3.4 

Subj.  47 

2 

2 

1 

1 

2 

2.5 

2.9 

2.4 

4.1 

Subj.  48 

2 

2 

2 

2 

3 

3.0 

2.8 

3.8 

3.3 

Subj.  49 

2 

1 

1 

2 

2 

3.5 

2.8 

2.9 

4.1 

Subj.  50 

2 

1 

1 

2 

3 

2.4 

2.6 

3.0 

4.6 

Subj.  51 

2 

1 

1 

2 

3 

3.3 

2.6 

2.5 

3.8 

Subj.  52 

2 

1 

1 

2 

2 

2.9 

2.8 

3.0 

3.8 

Subj.  53 

2 

1 

1 

1 

1 

3.7 

2.7 

3.4 

4.0 

Subj.  54 

2 

1 

2 

2 

2 

2.4 

3.0 

2.6 

4.1 

Subj.  55 

2 

1 

1 

2 

3 

3.4 

2.9 

4.2 

3.3 

Subj.  56 

2 

1 

1 

2 

1 

2.7 

2.6 

2.4 

3.5 

Subj.  57 

2 

1 

2 

1 

1 

2.7 

2.6 

2.8 

3.0 

Subj.  58 

2 

1 

1 

1 

1 

3.3 

3.3 

3.4 

5.0 

Subj.  59 

2 

1 

1 

1 

3 

2.3 

2.7 

mm 

3.6 

Subj.  60 

2 

1 

1 

1 

3 

3.0 

2.9 

3.2 

4.4 

Subj.  61 

2 

1 

1 

1 

3 

2.7 

2.9 

2.8 

3.8 

Subj.  62 

2 

1 

1 

:lj 

3 

2.8 

3.2 

3.8 
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Table  31 .  LN  Transformation  of  Response  Time  for  Statisticai  Analyses  (continued). 


2D-Bar 

2D-Bar 

2D-Bar 

HL 

LH 

Li 

2.5 

2.5 

3.2 

2.9 

2.4 

3.6 

2.4 

2.1 

3.1 

2.2 

2.5 

3.3 

2.7 

2.8 

3.4 

2.5 

2.8 

KOI 

3.6 

3.1 

3.3 

2.8 

2.6 

4.4 

3.1 

2.8 

4.6 

2.5 

3.2 

3.5 

2.7 

3.8 

2.5 

2.7 

3.2 

2.8 

2.6 

3.9 

2.9 

3.6 

3.6 

3.7 

3.7 

4.4 

2.8 

3.0 

2.9 

2.2 

2.8 

3.5 

3.0 

3.1 

4.0 

3.4 

2.6 

3.4 

2.7 

2.2 

3.7 

2.8 

3.3 

3.7 

3.0 

2.6 

2.3 

2.9 

2.6 

3.4 

2.8 

2.8 

3.9 

3.0 

2.5 

3.9 

2.6 

2.9 

2.6 

2.5 

2.6 

3.2 

2.4 

2.6 

3.0 

2.9 

3.3 

4.1 

2.9 

2.9 

2.9 

2.4 

2.4 

3.3 
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Table  31 .  LN  Transformation  of  Respor^e  Time  for  Statistical  Analyses  (continued). 


Subject 

Data 

Subj.  32 

2 

Subj.  33 

2 

Subj.  34 

2 

Subj.  35 

2 

Subj.  36 

2 

Subj.  37 

2 

Subj.  38 

2 

Subj.  39 

2 

Subj.  40 

2 

Subj.  41 

2 

Subj.  42 

2 

Subj.  43 

2 

Subj.  44 

2 

Subj.  45 

2 

Subj.  46 

2 

Subj.  47 

2 

Subj.  48 

2 

Subj.  49 

2 

Subj.  50 

2 

Subj.  51 

2 

Subj.  52 

2 

Subj.  53 

2 

Subj.  54 

2 

Subj.  55 

2 

Subj.  56 

2 

Subj.  57 

2 

Subj.  58 

2 

Subj.  59 

2 

Subj.  60 

2 

Subj.  61 

2 

Subj.  62 

2 

Educ.  Task> 
Train. 


Mode>  2D-Bar 


HH 


2D-Bar  2D-Bar  2D-Bar 


3.2 

2.6 

3.3 

2.9 

2.9 

2.8 

2.8 

3.9 

2.8 

3.3 

3.0 

3.3 

2.9 

CM 

2.7 

2.8 

3.9 

3.0 

3.2 

3.9 
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Table  31 .  LN  Transformation  of  Response  Time  for  Statistical  Analyses  (continued). 


Subject  Data  Gender  Rank 


Subj.  1 


Sub).  2 


Subj.  3 


Subj.  4 


Subj.  5 


Subj.  6 


Subj.  7 


Subj.  8 


Subj.  9 


Subj.  10 


Subj.  1 1 


Subj.  12 


Subj.  13 


Subj.  14 


Subj.  15 


Subj.  16 


Subj.  17 


Subj.  18 


Subj.  19 


Subj.  20 


Subj.  21 


Subj.  22 


Subj.  23 


Subj.  24 


Subj.  25 


Subj.  26 


Subj.  27 


Subj.  28 


Subj.  29 


Subj.  30 


Subj.  31 


Mode> 
Educ.  Task> 


3D-Bar 


HH 


3D-Bar 


HL 


3D-Bar  3D-Bar 


3.3 

3.4 

2.6 

4.1 

2.5 

4.1 

2.4 

4.1 

3.1 

4.4 

2.9 

3.8 

2.8 

3.4 

3.3 

4.0 

2.7 

3.3 

2.6 

3.6 

2.2 

3.3 

3.6 

4.1 

3.3 

2.9 

2.8 

3.8 

Table  31.  LN  Transformation  of  Resportse  Time  for  Statistical  Analyses  (continued). 


Subject 

Data 

SubJ.  32 

2 

Subj.  33 

2 

Subj.  34 

2 

Subj.  35 

2 

Subj.  36 

2 

Subj.  37 

2 

Subj.  38 

2 

Subj.  39 

2 

Subj.  40 

2 

Subj.  41 

2 

Subj.  42 

2 

Subj.  43 

2 

Subj.  44 

2 

Subj.  45 

2 

Subj.  46 

2 

Subj.  47 

2 

Subj.  48 

2 

Subj.  49 

2 

Subj.  50 

2 

Subj.  51 

2 

Subj.  52 

2 

Subj.  53 

2 

Subj.  54 

2 

Subj.  55 

2 

Subj.  56 

1 

2 

Subj.  57 

2 

Subj.  58 

2 

Subj.  59 

2 

Subj.  60 

2 

Subj.  61 

2 

Subj.  62 

2 

Mode> 
Educ.  Task> 


3D-Bar 


HH 


3D-Bar  3D-Bar  3D-Bar 
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Table  31 .  LN  Transformation  of  Resportse  Time  for  Statistical  Analyses  (continued). 


Subject  Data  Gender  Rank 


Subj.  1 


Subj.  2 


Subj.  3 


Subj.  4 


Subj.  5 


Subj.  6 


Subj.  7 


Subj.  8 


Subj.  9 


Subj.  10 


Subj.  1 1 


Subj.  12 


Subj.  13 


Mode> 
Educ.  Task> 


Subj.  29 


Subj.  30 


Subj.  31 


2D-ljne 

2D-lJne 

2D-|jne 

HH 

HL 

LH 

3.2 

3.3 

2.3 

2.7 

3.6 

2.6 

2.4 

2.6 

2.3 

2.3 

2.6 

2.7 

2.8 

2.5 

2.5 

3.0 

2.8 

^m\ 

3.0 

3.4 

3.6 

2.7 

■BBI 

2.2 

3.1 

2.6 

2.5 

2.6 

2.8 

2.5 

2.1 

2.6 

2.7 

2.6 

3.4 

2.5 

3.0 

2.9 

3.0 

3.3 

■91 

2.8 

3.4 

3.3 

2.8 

2.7 

3.3 

2.2 

2.2 

2.5 

mm\ 

2.9 

3.0 

2.8 

2.5 

2.6 

2.7 

2.5 

2.8 

2.5 

2.8 

3.0 

2.6 

2.8 

2.9 

2.6 

2.4 

2.4 

3.6 

2.8 

2.8 

2.4 

2.5 

2.9 

2.6 

2.6 

2.6 

2.5 

3.1 

2.5 

2.4 

2.4 

3.0 

2.4 

3.1 

3.0 

3.2 

3.0 

9^11 

2.6 

2.2 

2.6 

2.6 
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Table  31 .  LN  Transformation  of  Response  Time  for  Statistical  Analyses  (continued). 


Subject 

Data 

Subj.  32 

2 

Subj.  33 

2 

Subj.  34 

2 

Subj.  35 

2 

Subj.  36 

2 

Subj.  37 

2 

Subj.  38 

2 

Subj.  39 

2 

Subj.  40 

2 

Subj.  41 

2 

Subj.  42 

2 

Subj.  43 

2 

Subj.  44 

2 

Subj.  45 

2 

Subj.  46 

2 

Subj.  47 

2 

Subj.  48 

2 

Subj.  49 

2 

Subj.  50 

2 

Subj.  51 

2 

Subj.  52 

2 

Subj.  53 

2 

Subj.  54 

2 

Subj.  55 

2 

Subj.  56 

2 

Subj.  57 

2 

Subj.  58 

2 

Subj.  59 

2 

Subj.  60 

2 

Subj.  61 

2 

Subj.  62 

2 

Mode> 
Educ.  Task> 


2D-Line 


HH 


2D-lJne  2D-IJne  2D-Line 
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Table  31 .  LN  Transformation  of  Response  Time  for  Statistical  Analyses  (continuecD. 


Subject  Data  Gender  Rank 


SubJ.  1 


Subj.  2 


Subj.  3 


Subj.  4 


Subj.  5 


Subj.  6 


Subj.  7 


Subj.  8 


Subj.  9 


Subj.  10 


Subj.  11 


Subj.  12 


Subj.  13 


Subj.  14 


Subj.  15 


Subj.  16 


Subj.  17 


Subj.  18 


Subj.  19 


Subj.  20 


Subj.  21 


Subj.  22 


Subj.  23 


Subj.  24 


Subj.  25 


Subj.  26 


Subj.  27 


Subj.  28 


Subj.  29 


Subj.  30 


Subj.  31 


Mode> 
Educ.  Task> 


3D-Line 


HH 


3[>lJne  3D-Line  3D-ljne 


Table  31 .  LN  Transformation  of  Resporrse  Time  for  Statistical  Analyses  (continued). 


Subject 

Data 

Subj.  32 

2 

SubJ.  33 

2 

Subj.  34 

2 

Subj.  35 

2 

Subj.  36 

2 

Subj.  37 

2 

Subj.  38 

2 

Subj.  39 

2 

Subj.  40 

2 

Subj.  41 

2 

Subj.  42 

2 

Subj.  43 

2 

Subj.  44 

2 

Subj.  45 

2 

Subj.  46 

2 

Subj.  47 

2 

Subj.  48 

2 

Subj.  49 

2 

Subj.  50 

2 

Subj.  51 

2 

Subj.  52 

2 

Subj.  53 

2 

Subj.  54 

2 

Subj.  55 

2 

Subj.  56 

2 

Subj.  57 

2 

Subj.  58 

2 

Subj.  59 

2 

Subj.  60 

2 

Subj.  61 

2 

Subj.  62 

2 

Mode> 
Educ.  Taslo 


3D-iJne 


HH 


3D-Line 


HL 


3D-Line  3D-Une 
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Appendix  F.  Variance-Covariance  Matrix  Calculations  and  Power  Test 


This  ^pendix  contains  the  variance-covariance  matrices  and  the  calculations 
performed  to  test  whether  or  not  they  met  the  homogeneity  and  circularity  criteria 
(Tables  32-38).  The  appendix  also  includes  the  calculations  performed  to  determine  the 
power  of  the  F  tests  used  in  tiiis  experiment  (Table  39). 


Table  32.  Matrix  Calculations  for  Homogeneity  and  Circularity  Tests. 


N‘=  60 
n=  30 
P=  2 
q=  20 

IS1I=  1.08E-21 
IS2I=  4.32E-22 
I  Spooled  I  =  6.49E-19 
ISol=  8.73E-17 

n"lnlSl  1=  -1448.36 
n’‘lnlS2l=  -1475.82 
Total=  -2924.18 

N'*lnlSpooledl=  -2512.77 


Table  33.  Test  for  Homogeneity. 


Table  34.  Test  for  Circulorrty. 


Ml= 

411.419 

Cl  = 

0.341 

fl  = 

210.000 

X1A2= 

271.177 

X1A2(.05.210)= 

244.808 

Pvalue= 

0.003 

M2=  284.351 
C2=  0.119 

f2=  208.000 
X2A2=  250.614 
X2A2(.05.208)=  242.647 
Pvalue=  0.023 


Table  36.  Variance-Covariance  Matrix  for  Group  2  (G2). 
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0.036  0.060  0.046  0.075  0.041  0.044  0.048  0.078  0.051  0.016  0.060  0.048  0.030  0.074  0.029  0.078  0.057  0.031  0.008  0.207 


Table  38.  So  Variance-Covariance  Matrix. 
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Table  39.  Power  Test  Calculotior^ 


Means  (u) 


cl 

c2 

c3 

C4 

b1 

2.8088 

2.8553 

2.9884 

3.8311 

ti2 

2.8222 

2.8725 

2.8445 

3.6203 

b3 

2.9022 

3.0653 

2.8561 

3.6900 

b4 

2.7868 

2.9222 

2.8747 

3.4621 

bS 

3.2467 

2.7607 

2.9868 

3.3757 

Mean  of  Means  (u.) 
3.0786 

(u-u.)*2 


cl 

c2 

c3 

C4 

b1 

0.0728 

0.0499 

0.0081 

0.5663 

b2 

0.0658 

0.0425 

0.0548 

0.2934 

b3 

0.0311 

0.0002 

0.0495 

0.3738 

b4 

0.0852 

0.0245 

0.0416 

0.1471 

b5 

0.0282 

0.1011 

0.0084 

0.0883 

Knowns  (Conservative  F  test) 

vl  1.0  v2  60.0 

r  20.0 

Clalcuiated 

a  0.5382  (j)  3.4 

P0wer>  0.99 
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This  appendix  contains  the  summary  tables  and  summary  analysis  of  variance  tables 
used  in  the  statistical  analysis  provided  in  Chapter  4.  There  are  five  cases  in  all.  In  each 
case  Factor  A  represents  a  different  factor.  In  Tables  40  and  41  Factor  A  is  the  data-set 
combinations.  Factor  A  is  training  level  in  Tables  42  and  43,  and  rank  in  Tables  44  and 
45.  In  Tables  46  and  47  Factor  A  is  Gender,  and  Factor  A  is  educational  level  in  Tables 
48  and  49. 
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Table  4 1 .  ANOVA  Summary  Tables 
for  Data-Set  Combination  (Factor  A)  (continued). 

BXsubjw.  61  SUMMARY  TABLE  C  X  subj  w.  61  SUMMARY  TABLE 


m£su 

KH 

w^m 

04 

Ka 

1 

ilEia 

ijimsi 

11.34 

2 

■Ci£] 

ilE^ 

12.64 

WkX«221 

3 

■laid 

■rJ:M 

ip-ya 

4 

msKM 

■Tililtl 

5 

Hr>J 

iBs^a 

■P]R:l 

12.71! 

6 

UKU 

BlMil 

■WKil 

UKU 

■wr«u 

7 

■Eini 

13.74 

■WIFI 

8 

WtTiia 

UKia 

■gT»y:l 

9 

lglK*J 

^rrrr 

■Wr:l:l 

10 

■rix«M 

Hggl 

■rJ;Tf 

■nx«;a 

■ftigra 

mm 

Wtf^J 

maa 

■WWtl 

■iwyn 

■WK*1 

mum 

iioa 

UE&I 

i£ia 

wum 

■ftTSYJ 

■W»l 

■WICT 

■WiT;l 

i££a 

iHEa 

11^ 

■WRll 

mum 

■wf-ni 

■Piira 

■HKil 

16 

HKgl 

17 

■wpa 

■riifei 

MItllfSIM 

■r«x*i 

mum 

■Mia 

BWlrll 

fcXrSl 

Mfiwa 

19 

■KfcMI 

mam 

■TilWa 

20 

Tff;a 

BlliTil 

■uga 

BWr»T»l 

MVMifM 

■Kgl;l 

wmiii 

KSII 

Mtm 

il<£a 

■Wftlcl 

■a 

nsa 

■wna 

ilEgl 

■IIK^ 

MSSEk 

mcgi 

UKa 

■M»11 

itpii 

■WW^l 

Kityj 

iiidi 

■££3 

■a 

masi 

nwa 

ma^ 

■IBcU 

TiXra 

ipfia 

UKII 

iPt»3 

■n 

masM 

WlMl 

■riI;T;l 

TilKl 

ilia 

IQH 

IQUJ 

masM 

■ESI 

uatj 

■Blkgl 

iHK»l 

BlW;r>l 

UEa 

■H 

wmM 

l&Ell 

12.161 

■■■ 

msm 

msm 

msm 

1 

15.46 

MSSM 

■1tX»I;l 

■FJWil 

2 

14.96 

iBsa 

14.44 

3 

■WKil 

Wtva 

10^ 

wmi 

4 

■XlXl 

masM 

UEa 

■x-ita 

6 

■gicia 

■Qga 

■ginia 

■XX-Fl 

6 

■Rf« 

mnwnt 

■wi*;.i 

■FiKl 

7 

MCTi>l 

ma^ 

8 

■g1W:l 

mmi 

■CT?:l 

9 

wmsL 

■£££! 

WKOl 

10 

12.64 

■wr;ia 

mnwi 

mm 

11 

i££U 

■ggni 

14.42 

ig»MM 

HdH 

MLm 

■glFJ 

13.43 

■Fiy;l 

HU 

■rawti 

■KXrH 

wem 

■FJ»yi 

14 

15.47 

■Qga 

■T:l^ 

15 

juaai 

16 

mvm 

■XXi];l 

■E£21 

mam 

■Wffil 

■Wg»l 

masia 

■tapii 

18 

10:3 

Mwa 

19 

14.63 

14.77 

■Cl!^ 

■WfcTil 

20 

1 2.92 

13.29 

1^77^ 

16.51 

21 

14.36 

■EUI 

MLssa 

I6.6I 

22 

1436 

■PMl 

icsa 

■FJiffl 

msm 

i££ig 

■I^KFl 

1 

i 

mm 

14.35 

■KX»2a 

■£^ 

■la 

■^1 

14.51 

14.12 

■xx*;ti 

msm 

14.71 

mtiKia 

■Riwa 

■WFll 

27 

■££23 

mnw.ti 

wtna 

16.64] 

28 

■WFgl 

WHFZil 

MBSa 

■ana 

29 

■raww 

■rar»>i 

masa 

30 

■MWtl 

■ltX*jcl 

■xmn 

1— 

IW 

14.14 

13:22^ 

17.701 

S 
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Table  41.  ANOVAJ 
for  Data-Set  Combination 


B  X  subi  w.  62  SUMMARY  TABLE 


■H 

■iW 

“53“ 

“ST- 

KBI 

T«iKn 

■iPgl 

■WMa 

■WK:l 

HKil 

■MM 

BBP«^ 

34 

^5:34^ 

■UM 

■IMl 

■WTtfa 

35 

■WITH 

BftHTll 

■MM 

■MO 

■lEy 

MmM 

■wr»]a 

■l« 

■££21 

■ME] 

nrzii 

■MM 

■riT:M 

■MM 

■wru:! 

Bwwa 

■MM 

39 

■riiK«j 

mill 

■UM 

TilRfl 

TilR*l 

40 

■wgrfl 

■riy:n 

■nipa 

BHflVl 

KH 

■ftlKrl 

UB£1 

■MU 

■wwa 

■MM 

43 

■MM 

mwn 

■wy/a 

■MM 

■MU 

44 

■MM 

mvtfZM 

wtita 

msm 

45 

■HO 

■itKa 

BgWT«l 

46 

UTiyj 

WTil'Z*! 

■l!££i 

47 

BWPfil 

■M2I 

■HU 

■i^ 

■t£a 

■wrgi 

■WK»1 

Bnwa 

DBa 

49- 

■MU 

■MU 

HIKSl 

IK2B 

■MKl 

■MU 

■MWtl 

■MM 

■ttytni 

mum 

■MK«1 

■MLI 

■MU 

WiTR»l 

■H 

■CT>T:1 

■MU 

■WKil 

■MU 

^3^ 

■WUr;! 

11.45 

■wwa 

54 

■MM 

MtE3t 

»Tir«i 

55 

■MM 

■MM 

KBI 

UEil 

■MM 

^7^ 

■UHI 

11.12 

Tr92^ 

iiisr 

11.19 

53 

12.71 

BCTlrl 

■iciia 

13.12 

59 

■igyj 

■Wg«l 

Mgyii 

■mm 

50 

■MS 

■CT:!a 

■FtPia 

61 

■mm 

■witya 

■MU 

■MM 

■IHWcl 

62 

■mm 

■MM 

■pga 
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lary  Tables 
tor  A)  (continued). 


C  X  subi  w.  62  SUMMARY  TABLE 


imn 

msm 

KB 

WBsm 

msm 

KB 

■MU 

■Elga 

■wr«?a 

^3- 

waai 

■MU 

■larni 

KB 

■Elga 

■EHrll 

■rargi 

■ggii 

^5^ 

■Efe<a 

■MU 

■MEl 

■ESB 

maiin 

14.16 

■MM 

mism 

■MM 

■wr»i 

■Mwa 

^8^ 

■icir?a 

witym 

■gg«l 

watia 

K2B 

■mm 

■1W»J 

■WKa 

■rarai 

■EiSB 

■wEia 

■MM 

KUl 

■laai 

mvM.yM 

■Mraa 

■MU 

■MMl 

■latEi 

■fzia 

43 

■iay;si 

■MWrl 

■Q^ 

■wwa 

44 

■ESM 

■gnti 

■ggcl 

wain 

45 

■lazii 

wacii 

■griia 

■MKll 

46 
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■WEll 

■iffai 

■gMd 

47 

■Ell*l 

■rif:Ta 

48 
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■gEia 

■Hga 

49 

■El^ 

■ttMl 

■gg«i 

50 

TXTT 

14.56 

21.43 

51 

16.41 

BEir»Yl 

14.74 

T5:2r 

52 

TOT 

14.74 

14.46 

19.70 

53 

1337" 

14.08 

14.46 

■MU 

54 

wa»i 

■EUgi 

wm^i 

65 

warm 

14.69 

15.95 

17.91 

56 

■MM 

wtwa 

waga 

16.55 

msm 

■QUl 

■Eurm 

■gEia 

15.87 

16.24 

■MH^i 

■MU 

m^m 

13.90 

13.66 

16.78  1 

60 

■gga 

■lagi 

15.74 

■gtiia 

61 

■tatyj 

14.96 

wa»^i 

KB 

wciga 

15.69 

16.00 
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Table  43.  ANOVA  Summary  Tables  far  Trairrirtg  Level  (Factor  A). 
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Table  43.  ANOVA  Summary  Tables 
for  Training  Level  (Factor  A)  (continued). 


BXsutHw.GI  SUMMARY  TABLE  C  X  subj  w.  61  SUMMARY  TABLE 


■a 

mm 

KUi 

3S 

1 

UE^ 

11.16 

■ua 

13.44 

2 

■£1W;l 

■IK2I 

wmi 

12.64 

■WKSl 

5 

Bim*j 

mimi 

rntmiM 

6 

■lea 

■■mil 

■i£!l 

■IKH 

■Wfiia 

9 

■i^«i 

■un 

■wr;fa 

10 

11.64 

TlX-M 

■fig?:! 

13 

wmi 

12.16 

■Wl:?l 

14 

■pf-i-i 

■mi 

■HKrl 

■wrai 

22 

■[•KM 

■mi 

■iga 

■mi 

■mi 

■ir*ri 

12.64 

■filial 

12-16  i 

^4 

imi 

■IBM 

■IMl 

■Itlgl 

■wfiia 

33 

il!££i 

■wrm 

■ua 

39 

■iK*ii 

■■■M 

■T«iia 

Tiga 

40 

■WETil 

■IfS^ 

■filPZl 

■u^ 

41 

■m*j 

■Ifi^ 

■lPil?l 

■i»»i 

43 

■mi 

■IMI 

■mi 

■mi 

■WTi^ 

45 

ilia 

■nitai 

■gUfil 

53 

wtir/;! 

■RgU 

■iipa 

■wwa 

56 

ilE?l 

TiliVl 

■fiita 

11.761 

■util 

iIRKI 

■Wl^il 

■IMM 

imi 

14.19 

■ttita 

■ltl« 

EB3H 

UU 

Hga 

msm 

1 

■mi 

■WKll 

2 

14.96 

is:9r 

■MRTil 

S 

14.39 

14.51 

■mi 

■mi 

6 

■taai 

mfmEi 

■WKa 

■uia 

9 

■raig;i 

■^IRZil 

■mi 

EOKfl 

10 

^5:64 

■ma 

■frfgil 

■£irAi 

HU 

toivim 

■raitli;! 

MWTiia 

14 

15.47 

14.52 

■Rlgl 

22 

14.56 

16.11 

■mi 

■FJi^ 

31 

■EUa 

■Wgll 

34 

MEEl 

■^*11 

T«1li^ 

■RRil 

38 

■Rf?a 

WtliTil 

■TiWJ 

39 

■WRa 

■1W;V1 

■raiia 

40 

■mi 

■trllTa 

■WKI?1 

41 

■Tciai 

■Ttiai 

■Wf^l 

15.69  1 

43 

■mi 

■mi 

vas2k\ 

45 

■Tagil 

■mu 

■Miia 

■MKil 

53 

■laa 

■CTiltl 

14.46 

■r;lW;l 

■1^ 

■mi 

fcnanai 

■mi 

14.20 

■Ttltl;! 

■Tapa 

63 

waiai 

16.24 

16.54 

19:491 

B  X  subi  w.  62  SUMMARY  TABLE 


rnsn 

31 

HU 

UHUi 

B4 

rjEi 

13.27 

■mi 

■WWtl 

TTST 

1'2.T9 

HU 

MEM 

■UTiT;! 

■WIM 

■ua 

■MM 

riB- 

■Taiisi 

■mi 

■mi 

■mi 

HU 

■TclPtl 

■iii^ 

■mi 

■BiKa 

^4^ 

■mi 

■mi 

■mi 

■ua 

■mi 

25 

mm:tj 

■Wk»l 

■MM 

■IKil 

■M;a 

26 

mntzM 

■filM 

■WMl 

Etm 

28 

■WMl 

■IWi 

■liiiia 

msm 

■ua 

"29 

■MM 

■mi 

■mi 

■Ma 

■mj 

33 

mVMVM 

■mi 

■IKTll 

■wira 

47 

Tr92^ 

■mi 

^2:97^ 

-JUT 

49 

■MM 

■ItXrli 

■IfStl 

11.96 

52 

■Wli%-1 

■mi 

■MrM 

54 

■Wifil 

■M.il 

■mi 

■Mfil 

■mi 

C  X  subj  W.  62  SUMMARY  TABLE 


HU 

■•M 

u^ 

^1 

iuiu 

■M;ia 

■gIPil 

14.42 

wiiwm 

mm 

■mi 

13.43 

■Mi»fa 

UKU 

15.94 

■Tswa 

wiaa 

■KM 

■gltTil 

aim 

■wka 

u^ 

■ua 

■mi 

■M-gl 

mem 

mm 

15.77 

■mi 

■MM 

■T:lr)a 

warn 

■™il 

■ta^a 

■WMl 

■WPil 

mm 

■KlRBl 

■mi 

■itiai 

■Taca 

16.21 

14.57 

■HfiM 

■HTia 

'HU 

■g'llTll 

waai 

mm 

■TSKil 

1  47 

■mi 

■lagi 

■mi 

■Wf;ia 

HU 

14,74 

13.61 

■t»Ka 

■fciTa 

T7133" 

14.74 

14.46 

mtm 

54 

■mi 

■mi 

■QQ3 

■ma 

T 


Table  43.  ANOVA  Summary  Tables 
for  Training  Level  (Factor  A)  (continued). 


B  X  subj  w.  G3  SUMMARY  TABLE 


C  X  subi  w.  G3  SUMMARY  TABLE 


■lli!;lTiVZlBWKnHKtMWr«a 


■CT:TaTOIMtlWtl1^« 
KIKamtlFilBlclilBCTgl 

£ 

■Rf:aW?Mfai 


■giHni»nicii^iwi[ia 


4.56 


14.6 


13.66 


ia»fliKBt5ai5!fcaBriai 

■FiUnWtlKil 

■Kii.itii.it%ii5iri>ii;iKa 


M 
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Table  45.  ANOVA  Summary  Tables  for  Rank  (Factor  A). 


Table  45.  ANOVA  Summa^  Tables 
for  Rank  (Factor  A)  (continued). 


BXsubjw.  61  SUMMARY  TABU  C  X  subj  w.  61  SUMMARY  TABU 


\mm 

HI 

IKS 

iKai 

T 

1  13.41 

1  11.62 

1  11.16 

lUKa 

iu£a 

3 

K£a 

mwm 

IIQSa 

1  11.531 

4 

mim 

IB?;! 

■riityj 

imsa 

MTilRkl 

6 

UKII 

■iU!] 

ima 

l■H^«Ta 

1 

14.10 

13.74 

■CTtia 

IIH^ 

M2.17^ 

9 

14.56 

■Rfgl 

1  11.77 

■WRRB 

10 

mtmi 

11.64 

Mitvm 

Tiga 

\mm 

\  11.42 

1TW 

HQ 

IBEia 

■RUM 

wKiia 

14.42 

»wr:rii 

mmi 

\mm 

Mfiim 

lUKS 

17 

■ftipg 

■Tilra 

■r»Tai 

T«X»J 

18 

■H«a 

■i^a 

■giKa 

1  13.77 

14.53 

19 

mam 

BRgll 

WTiiai 

11.59 

20 

UiUd 

TiTili 

UTiTil 

■TilPBi 

21 

msm 

■I£|| 

22 

■r«ip^ 

■Qia 

MEa 

■Wltl 

\msm 

■ua 

■lEa 

H»S1 

r^4- 

uau 

1 

■ 

■f£S] 

■ua 

■MRU 

■la 

wtyoi 

mmvM 

mtKiM 

mam 

weal 

■wTiini 

WMm 

^7^ 

TiX»a 

■WKa 

UKII 

■wr«Ta 

28 

■MWl 

lieu 

■ftga 

Uta 

29 

miivn 

■Rika 

■WRgl 

Hua 

■wai 

usm 

lilRlB 

■RlPl 

■WKrl 

ilE3 

■Hgl 

■Rfca 

wkjta 

■ua 

MWB 

■RIKSl 

^5^ 

UAU 

■ftlftl 

■RI;T1 

■Rfc£l 

36 

■£££] 

■RIH;! 

■Mta 

mem 

■RTtyj 

IRWgl 

Msm 

■H 

■I!£U 

Bw^r»i 

mam 

■wwsi 

tt£a 

Tiiwa 

1F>11 

lUKl 

TiiRa 

H1R*1 

40 

■QEig 

11.64 

10.46 

■Hl>l 

42 

■Rwa 

■wra 

■WBSl 

13.641 

43 

uau 

1]71 

Ha 

mam\ 

44 

■MKil 

■Wgl 

■Rita 

■Rf»J 

MESm 

A1 

■WK«1 

■ua 

12.57 

■mil 

■Esm 

■esii 

11.96 

izsn 

■^1 

■RTnai 

■WWtl 

■RX»2;l 

■RIRHI 

■Ruai 

■wirq 

■Riroa 

Msm\ 

wmi 

mam 

■MB’?! 

uKa 

Ha 

■>« 

K£2ai 

Ha 

■WR?! 

12.14 

ufiiai 

UEHMl 

■ftiRai 

11.76 

^8^ 

14.98 

12.71 

14.19 

13.15 

13.12 

10.99 

1 1 .47 

1230' 

11.60 

12.16 

mSEiMl 

■Ri;g 

masMi 

■alia 

HEUli 

1^1 

Hill 

■RTERII 

U£a 

Kail 

12.76  1 

1235^ 

13121 

14,451 

iT3m 

lemn 

IHB 

\msm 

mxm 

1 

15.46 

iwEm 

■RXrRl 

■Wkltl 

3 

12:^ 

■E&a 

■WWW 

4 

13.13 

12.94 

11.87 

■Ry»Ri 

6 

MRftH 

13.74 

mm 

!  17.451 

7 

17.25 

WHRa 

lESa 

9 

■CTta 

i£^ 

mmi 

mm 

10 

12.64 

■Riyn 

14.731 

12 

MEm 

i£iy 

■Rial 

■WR1:1 

i5 

15.53 

16.10 

■Mta 

mm 

15 

■RlRl 

mmi 

■WRa 

17 

■Ml[il 

■FgRTil 

■Ry(fti 

16.41  1 

18 

■WTftl 

ioa 

BllRRB 

19 

■EfSkl 

14.77 

■atTii 

20 

■VX*?1 

13.29 

12.77 

16.51 

HH 

■ERRl 

■gilBBl 

14.23 

16,8i 

1  22 

mwM 

wEm 

■WTial 

KU 

■Eltriil 

KWRl 

■Mna 

17.35 

■££3 

■gfirl 

■RX*a 

17.59 

wmm 

■Era 

14.51 

MESa 

■Txati 

KU 

iora 

1339" 

■R1>X*I 

■WPll 

■lai 

■RlPil 

1371F 

16.64] 

KU 

msm 

■RW/il 

■Rita 

rz^ 

■ora 

14.57 

■rari?i 

■MKBl 

KflH 

WESEM 

17.70 

tyi 

itaa 

14.56 

17.06 

34 

14.58 

14.91 

Tiita 

MRiyill 

35 

i£^ 

16.41 

17.40 

19.14 

56 

■R-yga 

14.16 

14.44 

17.45 

HU 

■BRa 

■RfSkl 

IBlsSi 

■HkJtl 

KU 

13.65 

■Rfiiftl 

■HRM 

wraRRi 

^9^ 

1235 

UKa 

■WBa 

16,17  1 

40 

■Era 

13.16 

12.45 

i^a 

HU 

16.31 

■HRa 

■Hail 

43 

■RKgl 

mmi 

17.261 

44 

14.93 

■HIRB 

■RltRl 

masm 

47 

14.12 

15.54 

■Eua 

49 

14.74 

13.61 

15.60 

MfcKRl 

50 

■EH 

14.56 

Kiai 

HU 

16.41 

14.69 

14.74 

■RKa 

HU 

U«kB 

14.74 

14.46 

19.70  1 

15.57 

14,08 

14  46 

■Era 

HU 

■bffll 

msm 

■laaa 

17.91  1 

mmi 

■Rma 

■Ei^ 

■y»i^3 

■Ry;U 

16.24 

16.54 

■HKa 

14.39 

13.90 

13.66 

UlIU 

15.65 

15.54 

15.74 

KtMRl 

HU 

14.99 

15.32 

14.98 

BEEmI 

HU 

■RlRRl 

15.69 

16.00 

18.97  1 
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Table  45.  ANOVA  Summary  Tables 
for  Rank  (Factor  A)  (continued). 


B  X  subt  w.  G2  SUMMARY  TABLE 


K» 

KS 

mmM 

■Wki<l 

■WWtl 

■ie:!I 

■WIKI 

\mm 

mQ 

■MKT:l 

■Wr;T;l 

■M2I 

mu 

■IMI 

■IKiTil 

UEa 

■KM 

■wiki 

■WK;l 

mum 

mwait 

■ii:Ri 

mei 

mmi 

rntma 

■Ell!| 

Tiiia 

TtHa 

■lEOi 

■liSfii 

■l!£U 

HEI3I 

■wRa 

wiwa 

IKH 

mi!] 

■lE^ 

■raw 

■WRtl 

Kfl 

■iUi] 

■WRil 

■■ini 

C  Xsubj  w.  62  SUMMARY  TABLE 


E»I3H 

msm 

mu 

OTZ 

mu 

■^g[»l 

KTlVJ! 

HH 

■RKKl 

■KiaB 

■WTiU 

14 

mu 

■CT»1 

■T:Mgl 

30 

■rara 

■rajti 

■F.f;a 

33 

■CTiTil 

mu 

■WKtl 

41 

wtmii 

1 

s 

15.69  1 

45 

■raw 

■rail 

■M»ia 

■MKil 

46 

■WBi’l 

mu 

■rara 

46 

WtlR;! 

ma 

WHPa 

mfMiYM 

54 

■HtHl 

■aa 

■CTia 

■E£jU 

57 

■rara 

■gKll 

f' 
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r 


<D 

O 

c 

O 


T= 


o 

> 

o  o 
< 


O  0) 


6 

£ 

3 

VJ 


c 

<D 

o 


o 


® 

i3 

O 


u. 

s 

0.304279 1 

3 

2 

O 

■<r 

1.96222  1 

234.9537 

4.446284  I 

10.8599  1 

1  8916190 

0.283737 

0.932492 

m 

i 

O' 

3 

d 

0.272515 

I988ei0 

36.88089 

0.697937 

0.156971 

1 

Ui 

0.090168 

OO 

CM 

o 

Source  of  Variation  SS  cH 

Between  Subjects  56.23325  61 

- 

S 

Within  subjects  302.9229  1178 

■ST 

240 

CO 

cO 

180 

CM 

CM 

720 

0.283737 

55.94952 

2.597779 

1.090061 

CO 

CO 

CO 

1 10.6427 

z 

CO 

s 

CM 

28.25476 

18.97809 

1.082019 

104.8523 

< 

Sub]  w.  groups 
(error  (a)) 

CD 

AB 

8  X  subj  w.  groups 
(error  Cb)) 

O 

o 

< 

C  X  subj  w.  groups 
(error  (O) 

BC 

ABC 

BC  X  subj  w.  groups 
(error  (be)) 

—  >o 

O 

lO 

GO  CO 

CO 

GO 

5 

•O  CO 

0 

'O 

GO 

CM 

CM 

lO  >© 

CO 

cO 

CO 

CO  OO 

S 

5 

CM  — 

CM 

lO 

CO 

'Q  lO 

0 

GO 

lb  <> 
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lO  — 

U> 

lO 

■o 

liS  O 

d 

oo 

Q 

3 

P 

QO 

GO 

CO 

GO 

00 

oo  o 

'S 

> 

—  CM 

1— •  f— 

> 

oo 

CN 

c 

— 

' 

’ 

‘ 

c 

■^r 

O  CM 

lO 

o 

3r 

II 

II 

•I 

II 

It 

§ 

IN 

CM 

z 

Z  Q- 

G 

O' 

& 

•-  CM 

CO 

l|> 

"O  PS. 

«0 

CK 

o 

CM 

Ut 

■» 
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Table  47.  ANOVA  Summory  Tables  for  Gender  (Factor  A). 
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Table  47.  ANOVA  Summary  Tables 
for  Gender  (Factor  A)  (continued). 


B  X  subj  w.  61  SUMMARY  TABLE  C  X  subj  w.  61  SUMMARY  TABLE 


SUBJ# 

KU 

B3 

iKa 

B5 

1 

13.41 

11.52 

11.16 

lUEai 

13.44 

2 

11.89 

1319 

12.64 

12.96 

3 

“16.72 

0.87 

12.25 

10.48 

1 1.53 

4 

1i]g^ 

TiKa 

\vsm 

ITilMII 

5 

■U£] 

11.92 

1  12.76 

1  10.58 

1  12.71  1 

6 

1  11.31 

11.70 

■HKll 

iBoga 

l■Mia 

8 

mam 

12.63 

11.38 

l^griIa 

1  14.29 

14.56 

1314' 

11.77 

i■W^;f:l 

HEa 

11.64 

9.80 

10.96 

■[il6(»l 

11 

13.27 

12.72 

12.23 

11.50 

1  12.10  1 

i2 

TT.42 

11.66 

12.13 

11.45 

13 

■WTArl 

12.16 

12.38 

14 

12.62 

13.01 

11.99 

15 

“15.87 

14.42 

12.80 

13.56 

17 

“16.66 

10.75 

10.61 

16.22 

11.86 

18 

“15.06 

l2.0l 

14.05 

13.77 

14.53 

10 

"T5.05" 

12.07 

13.41 

16.75 

11.59 

■WRM 

12.48 

11.86 

12.31 

■BRl 

11.34 

12.89 

11.45 

11.95 

mam 

mam 

11.91 

LJ7 

Tl3r 

1247^ 

11.31 

■MilSl 

msm 

mssM 

■BQI 

■M;a 

TigRl 

mam 

20 

nan 

13.61 

14.18 

mam 

12.24 

36 

11.24 

11.80 

11.86 

31 

■QBII 

nca 

12.64 

16.51 

11.65 

Tii.-a 

11.56 

12.08 

mvmi 

■KWi;! 

■Mia 

■BFa 

■wri?j 

13.14 

■■Will 

msm 

HB 

■m*i 

11.01 

um 

TUga 

10.49 

40 

124(7 

10.84 

11.64 

10.46 

11.62 

41 

Tr.43' 

10.29 

11.06 

11.34 

11.22 

42 

12.17 

12.76 

12.76 

13.64 

45 

11.74 

mam 

13.18 

14.10 

46 

■Mia 

11.07 

16.70 

10.49 

49 

MtmM 

13.01 

11.63 

wmM 

11.96 

56 

KlEl 

■wwn 

■WK;! 

Mssm 

WBM 

BWKil 

13.14 

■wroi 

■Mia 

i^i 

12.55 

■WK*1 

■HEa 

12.92  1 

1375" 

12.38 

12.47 

54 

mmn 

■ElCjl 

55 

■WTia 

12.14 

56 

1T2C7 

11.60 

1W 

16.34 

11.76 

57 

II. 15 

11.12 

11.92 

12.50 

11.19 

53 

14.06 

12.71 

14.19 

13.15 

■Em 

59 

16.09 

11.47 

12.56 

11.60 

12.16 

HlSflll 

WSS^l 

13.54 

13.66 

12.92 

12.16 

12.36 

12.41 

13.78 

13.23 

'■PMI 

1275" 

i23r 

l3.l2 

14.45 

n.3o 

SUBJ# 

c::i 

msm 

!^B 

1 

15.46 

14.23 

13.08 

17.20 

2 

14.96 

15.07 

14.44 

10.86 

3 

■WEIl 

13.95 

■MM 

15.79 

4 

13.13 

12.94 

waam 

■Mta 

5 

14.39 

14.51 

14.88 

15.97 

6 

■M:ll 

13.74 

12.95 

17.45 

7 

14.28 

15.19 

14.68 

20.34 

6 

16.56 

14.70 

“14.67 

21.00 

9 

12.64 

12.87 

13.60 

14.73 

10 

■Miia 

■£g[ll 

14.42 

PgiMlI 

11 

■cm 

14.17 

13.43 

17.58 

12 

■raMi 

13.91 

16.33 

17.07 

13 

15.47 

14.52 

15.48 

18.74 

14 

15.53 

16.10 

■mi 

15 

■Mia 

massk 

13.08 

16.41  1 

16 

15.94 

lE^ 

17 

14.63 

14.77 

14.04 

■Mill 

18 

14.88 

14.11 

“14.23 

18.81 

10 

"mTO" 

14.13 

■MMl 

17.35 

26 

mam 

14.51 

14.12 

■raHcli 

21 

■WFil 

■MM 

16.64  1 

22 

13.76 

■MTil 

13.53 

■Mia 

16.21 

14.57 

■Mia 

mam 

15.23 

13.93 

15.55 

■M;a 

13.76 

14.14 

mam 

■MTilB 

126 

14.27 

■M*a 

■EiBWI 

17.06 

wasm 

WHR*1 

14.16 

14.44 

17.45 

13.63 

15.86 

19.22 

20 

12.55 

11.82 

■Ma 

16.17 

30 

13.42 

13.16 

12.45 

17.34 

HOB 

■MM 

13.53 

mam 

15.69 

ma^M 

16.31 

15.34 

19.43 

15.70 

15.31 

15.08 

10.96 

12.41 

“11.83 

15.93 

MB 

■CJ£| 

13.61 

15.66 

19.18 

36 

15.22 

14.13 

14.56 

mstm\ 

37 

16.41 

14.69 

14.74 

18.27 

36 

■HTia 

14.74 

14.46 

19.70 

15.57 

14.68 

14.46 

■MMI 

40 

irso" 

15.22 

^14.67 

10.76 1 

41 

IstO" 

14.60 

“15.05 

maam\ 

42 

12.73 

13.15 

13.26 

16.551 

43 

WtlMl 

■^fcTll 

■roa 

44 

■Mia 

16.24 

16.54 

■Rga 

45 

14.39 

13.90 

“i3.66 

16.78 

46 

15.55 

15.54 

15.74 

20.13 

47 

14.99 

15.32 

14.96 

18.64 

48 

■WMl 

15.60 

■rariTii 

■Ei^l 

1 
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Table  47.  ANOVA  Summary  Tables 
for  Gender  (Factor  A)  (continued). 


B  X  subj  w.  62  SUMMARY  TABLE 


KH 

TV 

B4 

TlZl 

14.36 

13.6d 

12.17 

16 

nKa 

■wrx«i 

X) 

Tiia 

■mi 

nrc«i 

■CIS&i 

22 

WETiU 

msai 

■WWtl 

■mi 

imi 

■mi 

■isa 

WWPtl 

■£2^ 

■ftiwtl 

mam 

■MWa 

■WIM 

umi 

MIKil 

MBIT;! 

■1^3 

■Mtia 

Uffil 

■HKW 

■WTtfa 

■tan 

■mi 

38 

12.46 

wsyjtiiM 

mm 

iom 

li.71 

■mi 

■wr>ia 

44 

■WKil 

MftW^ 

■E£a 

47 

K£!l 

m»L*m 

MIWJ 

■mi 

4d 

12.76 

12.65 

11.26 

11.72i 

C  X  subi  w.  62  SUMMARY  TABLE 


suaj# 

KD|i^ 

m*km 

49 

50 

15.12 

15.08 

17.84 

HSH 

12.92 

T3:2^ 

irrr 

16.51 

wtm 

16.11 

14.33 

17.06 

mm 

IaW 

13.^6 

17.59 

14.71 

13.89 

13.29 

17.40 

55 

■grrn 

Tiaci 

msm 

56 

14.66 

mai 

16.04 

15.50 

57 

16.41 

17.40 

19.14 

56 

13.65 

TTgiil 

■latTil 

waicTJ 

ITM 

13.96 

wmi 

■rajci 

warn 

60^ 

16.13 

rawa 

61 

14.12 

15.54 

■ElU 

62 

13.68 

14.64 

15.45 

17.32 

r 
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o 

o 

c 

o 

I? 

o 

<  S 

o  o 

I  o 

I  s 

CO  "o 
.  LU 

®  i; 
O 

® 

£i 

O 


u. 

Ui 

2 

4.043484  1 

4.700349 1 

2.2813521 

230.314  1 

3.1736491 

10.9218  1 

0.964674  1 

3.550373 

0.878048 

0.649445 

0.315213 

0.138169 

36.88089 

0.508206 

€€10910 

1.581508 

0.139688 

1 

c 

<A 

«A 

s 

B 

-e 

O 

> 

B 

• 

9 

3 

O 

Vi 

Between  Subjects  56.23325  61 

-- 

3 

Within  subjects  302.9229  1178 

1 

eo 

1 

CO 

180 

CM 

1 

CM 

720 

3.550373 

52.68288 

2.597779 

€990921 

33.16068 

1 10.6427 

1.524618 

28.82395 

18.97809 

1.676251 

104.258 

< 

Subj  w.  groups 
(error  (a)) 

CO 

AB 

B  X  subj  w.  groups 
(error  (b)) 

O 

U 

< 

C  X  subj  w.  groups 
(error  (c)) 

BC 

ABC 

BC  X  subj  w.  groups 
(error  (be)) 

—  o 

>0 

m 

CM  CO 

CO 

Mr 

o 

CO 

o 

'O 

CM 

CM 

O  CO 

oo 

OO 

OO 

00 

OO 

s 

3 

CM  — 

'9 

iO 

CO 

Q  OO 

CM 

CO 

m 

<> 

Q 

«o  — 

«o 

lO 

-o 

56  o 

CO 

O 

o 

Ml 

MT 

9 

rs. 

oo 

oo 

oo 

OO 

oo 

00 

o 

> 

•— 

> 

m 

CM 

C 

■ 

’ 

’ 

’ 

' 

■ 

c 

CM 
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•O  CM 

U5 

o 

II 

II 

Jl 

II 

II 

B 

o 

c 

z 

CM 

z 

Z  Q- 
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fO 
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00 

o 

CM 
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Table  49.  ANOVA  Summary  Tables 
for  Educational  Level  (Factor  A)  (continued). 


B  X  subj  w.  G1  SUMMARY  TABLE 


SUBJ# 

B1 

B2 

B3 

B4 

2 

14.28 

11.89 

13.39 

12.64 

12.96 

5 

11.79 

11.92 

12.76 

10.58 

12.71 

7 

14.10 

13.74 

14.35 

13.68 

12.17 

10 

10.96 

11.64 

9.80 

10.96 

10.48 

12 

11.42 

11.08 

12.13 

11.45 

13.12 

15 

13.87 

14.42 

12.80 

13.50 

14.56 

16 

13.42 

11.35 

13.42 

11.93 

12.79 

21 

12.66 

12.79 

12.48 

11.80 

12.31 

22 

13.82 

10.48 

14.07 

11.65 

12.03 

29 

13.17 

13.61 

14.18 

13.34 

12.24 

30 

13.19 

11.24 

12.50 

11.80 

11.86 

32 

11.65 

10.59 

11.56 

12.08 

12.97 

34 

12.34 

11.13 

11.91 

13.56 

12.08 

35 

12.71 

13.10 

14.86 

13.88 

12.94 

36 

12.25 

12.33 

11.53 

13.78 

12.06 

37 

13.49 

13.02 

13.14 

11.70 

12.70 

38 

10.87 

12.46 

12.08 

12.76 

12.96 

43 

12.13 

11.71 

12.78 

12.34 

12.07 

44 

12.95 

12.94 

13.35 

13.22 

14.20 

47 

11.92 

12.50 

12.97 

11.77 

12.57 

53 

13.78 

12.38 

12.47 

11.45 

12.26 

57 

11.15 

11.12 

11.92 

12.50 

11.19 

58 

14.98 

12.71 

14.19 

13.15 

13.12 

59 

10.99 

11.47 

12.50 

11.60 

12.16 

60 

13.56 

13.54 

13.86 

12.92 

13.08 

61 

12.16 

12.36 

12.41 

13.78 

13.23 

62 

12.76 

12.55 

13.12 

14.45 

11.30 

C  X  subj  w.  G1  SUMMARY  TABLE 


SUBJ# 

Cl 

C2 

C3 

C4 

2 

14.96 

15.97 

14.44 

19.80 

5 

14.39 

14.51 

14.88 

15.97 

7 

15.09 

17.25 

16.34 

19.35 

10 

12.64 

12.87 

13.60 

14.73 

12 

14.02 

14.17 

13.43 

17.58 

15 

15.53 

16.10 

17.24 

20.28 

16 

15.12 

14.85 

15.08 

17.84 

21 

14.88 

14.11 

14.23 

18.81 

22 

14.56 

16.11 

14.33 

17.06 

29 

16.21 

14.57 

16.02 

19.75 

30 

15.23 

13.93 

15.55 

15.89 

32 

14.27 

12.96 

14.56 

17.06 

34 

14.58 

14.91 

16.04 

15.50 

35 

14.55 

16.41 

17.40 

19.14 

36 

15.89 

14.16 

14.44 

17.45 

37 

15.34 

13.63 

15.86 

19.22 

38 

13.65 

13.80 

15.30 

18.38 

43 

13.96 

15.27 

14.53 

17.26 

44 

14.93 

15.13 

15.53 

21.07 

47 

14.12 

15.54 

14.19 

17.88 

53 

15.57 

14.08 

14.46 

18.23 

57 

14.20 

13.33 

14.90 

15.45 

58 

15.87 

16.24 

16.54 

19.49 

59 

14.39 

13.90 

13.66 

16.78 

60 

15.55 

15.54 

15.74 

20.13 

61 

14.99 

15.32 

14.98 

18.64 

62 

13.53 

15.69 

16.00 

18.97 
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Table  49.  ANOVA  Summary  Tables 
for  Educational  Level  (Factor  A)  (continued). 

BXsubiw.^  SUMMARY  TABLE  C  X  subi  w.  62  SUMMARY  TABLE 


R»igia 

mm 

mm 

“53“ 

B4 

B5 

6 

■KO 

MWZll 

12.90 

il.<>7 

8 

mtita 

■W»l 

■CTl^ 

13.64 

-TT77 

11 

wmi 

mvmM 

■Biurii 

■MU 

wtm 

■WBiil 

■MU 

u 

■wpyj 

■WRTa 

wmM 

■IK2I 

Tiiwn 

TilWrl 

18 

■CTl^SI 

■££a 

■MU 

19 

■WTiTl 

13.41 

TiTwa 

UK*! 

20 

Tunn 

12.41 

BBITOI 

WTlgYJ 

KB 

■MU 

■lEU 

BKM 

KB 

■wnti 

■»*« 

■iKa 

mm 

rntmi 

rntmi 

UKU 

■MU 

B^ 

mwwa 

■wryj 

11.55 

mvmit 

msm 

■ina 

■l!££| 

■MU 

■IKU 

mma 

kb 

mv»a 

Mum 

TiIiTJ 

■MSI 

BH 

■Us^l 

BMgj 

msa 

mVMVM 

■WKa 

■u^ 

39 

11.01 

11.13 

10.59 

Tiiga 
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